Aug 26 02:47:58 devstack cinder-volume[82690]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 02:47:58 devstack cinder-volume[82690]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 02:47:58 devstack cinder-volume[82690]: we strongly recommend against using it for new projects. Aug 26 02:47:58 devstack cinder-volume[82690]: If you are already using Eventlet, we recommend migrating to a different Aug 26 02:47:58 devstack cinder-volume[82690]: framework. For more detail see Aug 26 02:47:58 devstack cinder-volume[82690]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 02:47:58 devstack cinder-volume[82690]: import eventlet # noqa Aug 26 02:48:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:48:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:48:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:48:02 devstack cinder-volume[82690]: INFO dbcounter [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Registered counter for database cinder Aug 26 02:48:02 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:48:02 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writer thread running {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:48:02 devstack cinder-volume[82690]: INFO cinder.rpc [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 02:48:02 devstack cinder-volume[82690]: INFO cinder.rpc [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 02:48:02 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:48:02 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Determined volume DB was empty at startup. Aug 26 02:48:02 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82690) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 02:48:02 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 02:48:02 devstack cinder-volume[82690]: WARNING stevedore.named [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 02:48:02 devstack cinder-volume[82690]: WARNING castellan.key_manager [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:48:02 devstack cinder-volume[82690]: WARNING cinder.keymgr.conf_key_mgr [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.lvm [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82690) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] CMD "cinder-rtstool verify" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:48:03 devstack cinder-volume[82690]: INFO cinder.rpc [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 26 02:48:03 devstack cinder-volume[82690]: INFO cinder.rpc [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 26 02:48:03 devstack cinder-volume[82690]: WARNING stevedore.named [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 02:48:03 devstack cinder-volume[82690]: WARNING castellan.key_manager [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:48:03 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:48:03 devstack cinder-volume[82690]: INFO oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Starting 1 workers Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Started child 82841 {{(pid=82690) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Full set of CONF: {{(pid=82690) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] ******************************************************************************** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Configuration options gathered from: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] ================================================================================ {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 02:48:03 devstack cinder-volume[82841]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] allow_availability_zone_fallback = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] allow_compression_on_image_upload = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] allowed_direct_url_schemes = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] api_rate_limit = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] auth_strategy = keystone {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] az_cache_duration = 3600 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_availability_zone = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_host = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_stats_polling_interval = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backup_api_class = cinder.backup.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backup_name_template = backup-%s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backup_use_same_host = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backup_use_temp_snapshot = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] chap_password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] chap_username = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_internal_tenant_project_id = f5511e849ef5418bb3a5247379589052 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_internal_tenant_user_id = d5e5d82b40a44d16b3d48f62f4ff95b9 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cloned_volume_same_az = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cluster = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] compression_format = gzip {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] compute_api_class = cinder.compute.nova.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] config_dir = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] config_source = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] control_exchange = openstack {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] debug = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] default_availability_zone = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] default_group_type = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] default_volume_type = lvmdriver-1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] disk_geometry = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] driver_client_cert = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] driver_client_cert_key = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] driver_data_namespace = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] driver_ssl_cert_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] driver_ssl_cert_verify = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] driver_use_ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] enable_force_upload = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] enable_new_services = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] enable_unsupported_driver = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] enforce_multipath_for_image_xfer = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] filter_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_api_insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_api_ssl_compression = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_ca_certificates_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_catalog_info = image:glance:publicURL {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_num_retries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance_request_timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] goodness_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] graceful_shutdown_timeout = 5 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] group_api_class = cinder.group.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] host = devstack {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_compress_on_upload = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_conversion_address_space_limit = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_conversion_cpu_limit = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_conversion_disable = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_upload_use_cinder_backend = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_upload_use_internal_tenant = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_volume_cache_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_volume_cache_max_count = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] image_volume_cache_max_size_gb = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] init_host_max_objects_retrieval = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] instance_format = [instance: %(uuid)s] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] iscsi_target_flags = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] iscsi_write_cache = on {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] iser_helper = tgtadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] iser_ip_address = 192.168.122.13 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] iser_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82841]: INFO cinder.volume.manager [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 26 02:48:03 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_color = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_config_append = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_dir = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_options = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_rotate_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_rotate_interval_type = days {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] log_rotation_type = none {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] max_age = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] max_logfile_count = 30 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] max_logfile_size_mb = 200 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] max_over_subscription_ratio = 20.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] message_reap_interval = 86400 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] message_ttl = 2592000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] migration_create_volume_timeout_secs = 300 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] monkey_patch = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] monkey_patch_modules = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] my_ip = 192.168.122.13 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] no_snapshot_gb_quota = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] num_iser_scan_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] num_shell_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] num_volume_device_scan_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] nvmeof_conn_info_version = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] nvmet_ns_id = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] nvmet_port_id = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] osapi_max_limit = 1000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] osapi_volume_ext_list = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] osapi_volume_listen_port = 8776 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] osapi_volume_use_ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] osapi_volume_workers = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] per_volume_size_limit = -1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] periodic_fuzzy_delay = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] periodic_interval = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] public_endpoint = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] publish_errors = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] quota_backup_gigabytes = 1000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] quota_backups = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] quota_gigabytes = 1000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] quota_groups = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] quota_snapshots = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] quota_volumes = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] rate_limit_burst = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] rate_limit_except_level = CRITICAL {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] rate_limit_interval = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] reinit_driver_count = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] replication_device = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] report_discard_supported = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] report_interval = 120 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] reservation_clean_interval = 86400 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] reservation_expire = 86400 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] reserved_image_namespaces = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] reserved_percentage = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] rpc_response_timeout = 120 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] run_external_periodic_tasks = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] scst_target_driver = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] scst_target_iqn_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_down_time = 720 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] shell_completion = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] snapshot_name_template = snapshot-%s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] snapshot_same_host = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] state_path = /opt/stack/data/cinder {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] storage_availability_zone = nova {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] storage_protocol = iSCSI {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] syslog_log_facility = LOG_USER {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] target_helper = lioadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] target_ip_address = 192.168.122.13 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] target_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] target_protocol = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] target_secondary_ip_addresses = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] trace_flags = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] transport_url = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] until_refresh = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] use_chap_auth = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] use_default_quota_class = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] use_journal = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] use_json = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] use_multipath_for_image_xfer = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] use_stderr = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] use_syslog = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] verify_glance_signatures = enabled {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_api_class = cinder.volume.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_backend_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:03 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_clear = zero {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_clear_ionice = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_clear_size = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_copy_bps_limit = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_dd_blocksize = 1M {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_name_template = volume-%s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_service_inithost_offload = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volume_usage_audit_period = month {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] zoning_mode = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_concurrency.disable_process_locking = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.auth_section = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.auth_type = password {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.auth_version = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.cache = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.include_service_catalog = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.interface = public {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:03 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcache_username = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.region_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.service_type = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.backend = dogpile.cache.null {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.backend_argument = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.backend_expiration_time = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.config_prefix = cache.oslo {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.debug_cache_backend = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.enable_retry_client = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.enable_socket_keepalive = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.expiration_time = 600 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.hashclient_retry_attempts = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.memcache_dead_retry = 300 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.memcache_pool_maxsize = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.memcache_sasl_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.proxies = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.redis_db = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack sudo[82845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.redis_server = localhost:6379 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.retry_attempts = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.retry_delay = 0.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.socket_keepalive_count = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.socket_keepalive_idle = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack sudo[82845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.socket_keepalive_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.socket_timeout = 1.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.tls_allowed_ciphers = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.tls_cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.tls_certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.tls_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.tls_keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cache.username = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] coordination.backend_url = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.asyncio_connection = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.asyncio_slave_connection = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.backend = sqlalchemy {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.connection = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.connection_debug = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.connection_parameters = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.connection_recycle_time = 3600 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.connection_trace = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.db_inc_retry_interval = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.db_max_retries = 20 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.db_max_retry_interval = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.db_retry_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.max_overflow = 50 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.max_pool_size = 5 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.max_retries = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.mysql_wsrep_sync_wait = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.pool_timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.retry_interval = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.slave_connection = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.sqlite_synchronous = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.synchronous_reader = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] database.use_db_reconnect = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.connection_string = messaging:// {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.es_doc_type = notification {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.es_scroll_size = 10000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.es_scroll_time = 2m {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.filter_error_trace = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.hmac_keys = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.sentinel_service_name = mymaster {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.socket_timeout = 0.1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.trace_requests = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler.trace_sqlalchemy = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler_jaeger.process_tags = {} {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler_jaeger.service_name_prefix = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] profiler_otlp.service_name_prefix = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.enforce_new_defaults = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.policy_default_rule = default {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.policy_file = policy.yaml {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] privsep_osbrick.group = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] privsep_osbrick.helper_command = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] privsep_osbrick.user = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_sys_admin.group = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_sys_admin.helper_command = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] cinder_sys_admin.user = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.auth_section = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.auth_type = password {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.collect_timing = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.send_service_user_token = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] service_user.timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.auth_section = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.auth_type = password {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.collect_timing = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.region_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] glance.timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.backend_availability_zone = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.chap_password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.chap_username = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.disk_geometry = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.driver_client_cert = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.driver_client_cert_key = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.driver_data_namespace = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.driver_use_ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.extra_capabilities = {} {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.filter_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.goodness_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.iscsi_target_flags = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.iscsi_write_cache = on {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.iser_helper = tgtadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.iser_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.lvm_share_target = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:03 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.lvm_type = auto {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.num_shell_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.replication_device = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.report_discard_supported = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.reserved_percentage = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.target_helper = tgtadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.target_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.target_protocol = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.trace_flags = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.unique_fqdn_network = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.use_chap_auth = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_backend_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_clear = zero {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_clear_ionice = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_clear_size = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_reports.file_event_handler = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_reports.log_dir = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.backend_host = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.chap_password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.chap_username = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.disk_geometry = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.driver_client_cert = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.extra_capabilities = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.filter_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.goodness_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.iser_helper = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.iser_ip_address = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.iser_port = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.lvm_share_target = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.lvm_type = auto {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.num_shell_tries = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.replication_device = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.report_discard_supported = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.reserved_percentage = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.scst_target_driver = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.storage_protocol = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.target_helper = lioadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.target_ip_address = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.target_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.trace_flags = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.use_chap_auth = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_clear = zero {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_clear_size = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] lvmdriver-1.volumes_dir = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_notifications.driver = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_notifications.retry = -1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] key_manager.fixed_key = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.barbican_api_version = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.barbican_endpoint = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.barbican_endpoint_type = public {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.barbican_region_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.collect_timing = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.number_of_retries = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.retry_delay = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.send_service_user_token = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.verify_ssl = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican.verify_ssl_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.auth_section = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.auth_type = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.collect_timing = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] barbican_service_user.timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.approle_role_id = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.approle_secret_id = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.auth_method = approle {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.auth_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.kv_mountpoint = secret {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.kv_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.kv_version = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.namespace = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.root_token_id = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.ssl_ca_crt_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.timeout = 60.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.token_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.token_role = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.use_ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:48:04 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] ******************************************************************************** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 02:48:04 devstack sudo[82845]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:04 devstack sudo[82849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:04 devstack sudo[82849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:04 devstack sudo[82849]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.430s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 02:48:04 devstack cinder-volume[82841]: INFO cinder.brick.local_dev.lvm [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:04 devstack sudo[82858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:48:04 devstack sudo[82858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:04 devstack sudo[82858]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG cinder.brick.local_dev.lvm [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82841) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 26 02:48:04 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:05 devstack sudo[82938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:05 devstack sudo[82938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:05 devstack sudo[82938]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:05 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.826s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:05 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:05 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:05 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:05 devstack sudo[83230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:05 devstack sudo[83230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:06 devstack sudo[83230]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:06 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:06 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:06 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:06 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:06 devstack sudo[83335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 26 02:48:06 devstack sudo[83335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:06 devstack sudo[83335]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:06 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.343s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:06 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:06 devstack sudo[83460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:48:06 devstack sudo[83460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:06 devstack sudo[83460]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:06 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:06 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:06 devstack sudo[83463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:48:06 devstack sudo[83463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:07 devstack sudo[83463]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:07 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:07 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:07 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:48:07 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:07 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:07 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:07 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:07 devstack sudo[83550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:07 devstack sudo[83550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:07 devstack sudo[83550]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:07 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.326s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:07 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:07 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:07 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:07 devstack sudo[83587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:07 devstack sudo[83587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:08 devstack sudo[83587]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:08 devstack cinder-volume[82841]: INFO cinder.volume.drivers.lvm [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:08 devstack sudo[83644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:08 devstack sudo[83644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:08 devstack sudo[83644]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG cinder.volume.drivers.lvm [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Updating volume stats {{(pid=82841) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:08 devstack sudo[83653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:48:08 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:08 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:08 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:48:08 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:08 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:08 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:08 devstack sudo[83659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:08 devstack sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:09 devstack sudo[83659]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:09 devstack sudo[83662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:48:09 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:09 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:09 devstack cinder-volume[82841]: INFO cinder.volume.driver [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG cinder.volume.driver [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82841) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG oslo_db.sqlalchemy.engines [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG dbcounter [-] [82841] Writer thread running {{(pid=82841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG cinder.db.api [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Building query based on filter {{(pid=82841) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG cinder.image.image_utils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82841) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 02:48:09 devstack cinder-volume[82841]: INFO cinder.keymgr.migration [None req-d0f47cb2-f77a-443e-9a40-bdb13cd28e19 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG cinder.volume.drivers.lvm [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Updating volume stats {{(pid=82841) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:09 devstack sudo[83666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:48:09 devstack sudo[83666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:09 devstack sudo[83666]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:09 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:09 devstack sudo[83670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:48:09 devstack sudo[83670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:10 devstack sudo[83670]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:10 devstack sudo[83674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:10 devstack sudo[83674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:10 devstack sudo[83674]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:10 devstack sudo[83678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:48:10 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:10 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG cinder.manager [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Notifying Schedulers of capabilities ... {{(pid=82841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:48:10 devstack cinder-volume[82841]: INFO cinder.volume.manager [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Driver initialization completed successfully. Aug 26 02:48:10 devstack cinder-volume[82841]: INFO cinder.manager [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Initiating service 2 cleanup Aug 26 02:48:10 devstack cinder-volume[82841]: INFO cinder.manager [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Service 2 cleanup completed. Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG cinder.service [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Creating RPC server for service cinder-volume {{(pid=82841) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG cinder.service [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82841) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 02:48:10 devstack cinder-volume[82841]: INFO cinder.volume.manager [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG cinder.volume.drivers.lvm [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Updating volume stats {{(pid=82841) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:48:10 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:11 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:48:11 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:11 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:11 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:11 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:11 devstack sudo[83686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:48:11 devstack sudo[83686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:11 devstack sudo[83686]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:11 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:11 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:11 devstack sudo[83693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:48:11 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:11 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:11 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:11 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:48:11 devstack sudo[83697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:48:11 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:48:12 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root Aug 26 02:48:12 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:48:12 devstack cinder-volume[82841]: INFO cinder.volume.manager [None req-39e92b86-6653-48a9-b52f-0446861236b9 None None] Driver post RPC initialization completed successfully. Aug 26 02:48:13 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:48:20 devstack cinder-volume[82841]: DEBUG dbcounter [-] [82841] Writing DB stats cinder:SELECT=3 {{(pid=82841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:48:21 devstack cinder-volume[82841]: DEBUG oslo_service.periodic_task [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running periodic task VolumeManager._thread_info {{(pid=82841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:48:21 devstack cinder-volume[82841]: DEBUG cinder.volume.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] thread count: 6 {{(pid=82841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:48:21 devstack cinder-volume[82841]: DEBUG cinder.volume.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] thread info: [<_MainThread(MainThread, started 135707144519808)>, , , , , ] {{(pid=82841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:48:22 devstack cinder-volume[82841]: DEBUG dbcounter [-] [82841] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:49:21 devstack cinder-volume[82841]: DEBUG oslo_service.periodic_task [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:49:21 devstack cinder-volume[82841]: DEBUG cinder.volume.drivers.lvm [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Updating volume stats {{(pid=82841) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:49:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:49:21 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:49:21 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:49:21 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Aug 26 02:49:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:49:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:49:21 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:49:21 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:49:21 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Aug 26 02:49:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:49:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:49:21 devstack sudo[85771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:49:21 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:49:22 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root Aug 26 02:49:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:49:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:49:22 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:49:22 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:49:22 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Aug 26 02:49:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:49:22 devstack cinder-volume[82841]: DEBUG cinder.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Notifying Schedulers of capabilities ... {{(pid=82841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:49:22 devstack cinder-volume[82841]: DEBUG oslo_service.periodic_task [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running periodic task VolumeManager._thread_info {{(pid=82841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:49:22 devstack cinder-volume[82841]: DEBUG cinder.volume.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] thread count: 6 {{(pid=82841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:49:22 devstack cinder-volume[82841]: DEBUG cinder.volume.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] thread info: [<_MainThread(MainThread, started 135707144519808)>, , , , , ] {{(pid=82841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:50:21 devstack cinder-volume[82841]: DEBUG oslo_service.periodic_task [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:50:21 devstack cinder-volume[82841]: DEBUG cinder.volume.drivers.lvm [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Updating volume stats {{(pid=82841) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:50:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:21 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:50:21 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:21 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:21 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:21 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:21 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:21 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:21 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:22 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:22 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:22 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:22 devstack cinder-volume[82841]: DEBUG dbcounter [-] [82841] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:50:22 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:22 devstack cinder-volume[82841]: DEBUG cinder.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Notifying Schedulers of capabilities ... {{(pid=82841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:51:21 devstack cinder-volume[82841]: DEBUG oslo_service.periodic_task [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:51:21 devstack cinder-volume[82841]: DEBUG cinder.volume.drivers.lvm [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Updating volume stats {{(pid=82841) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:51:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:51:21 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:51:21 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:51:21 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Aug 26 02:51:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:51:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:51:21 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:51:21 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:51:21 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Aug 26 02:51:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:51:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:51:21 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:51:21 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:51:22 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Aug 26 02:51:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:51:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:51:22 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:51:22 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:51:22 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Aug 26 02:51:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:51:22 devstack cinder-volume[82841]: DEBUG cinder.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Notifying Schedulers of capabilities ... {{(pid=82841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:51:22 devstack cinder-volume[82841]: DEBUG oslo_service.periodic_task [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running periodic task VolumeManager._thread_info {{(pid=82841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:51:22 devstack cinder-volume[82841]: DEBUG cinder.volume.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] thread count: 6 {{(pid=82841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:51:22 devstack cinder-volume[82841]: DEBUG cinder.volume.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] thread info: [<_MainThread(MainThread, started 135707144519808)>, , , , , ] {{(pid=82841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:52:21 devstack cinder-volume[82841]: DEBUG oslo_service.periodic_task [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:52:21 devstack cinder-volume[82841]: DEBUG cinder.volume.drivers.lvm [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Updating volume stats {{(pid=82841) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:52:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:52:21 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:52:21 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:52:21 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Aug 26 02:52:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:52:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:52:21 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:52:21 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:52:21 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Aug 26 02:52:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:52:21 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:52:21 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:52:21 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:52:22 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:52:22 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:52:22 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG dbcounter [-] [82841] Writing DB stats cinder:SELECT=1 {{(pid=82841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG dbcounter [-] [82841] Writing DB stats cinder:UPDATE=1 {{(pid=82841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:52:22 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG oslo_concurrency.processutils [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=82841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG cinder.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Notifying Schedulers of capabilities ... {{(pid=82841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG oslo_service.periodic_task [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] Running periodic task VolumeManager._thread_info {{(pid=82841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG cinder.volume.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] thread count: 6 {{(pid=82841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:52:22 devstack cinder-volume[82841]: DEBUG cinder.volume.manager [None req-271c67f3-6841-4f01-a726-feb73b781c6f None None] thread info: [<_MainThread(MainThread, started 135707144519808)>, , , , , ] {{(pid=82841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:52:59 devstack cinder-volume[82690]: INFO oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Caught SIGTERM, stopping children Aug 26 02:52:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Acquiring lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:52:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Acquired lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:52:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Releasing lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:52:59 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Stop services. {{(pid=82690) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 02:52:59 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Killing children. {{(pid=82690) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 02:52:59 devstack cinder-volume[82690]: INFO oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Waiting on 1 children to exit Aug 26 02:53:00 devstack cinder-volume[82841]: DEBUG oslo_concurrency.lockutils [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Acquiring lock "singleton_lock" {{(pid=82841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:53:00 devstack cinder-volume[82841]: DEBUG oslo_concurrency.lockutils [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Acquired lock "singleton_lock" {{(pid=82841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:53:00 devstack cinder-volume[82841]: DEBUG oslo_concurrency.lockutils [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Releasing lock "singleton_lock" {{(pid=82841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:53:00 devstack cinder-volume[82841]: WARNING amqp [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 02:53:00 devstack cinder-volume[82841]: WARNING amqp [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 02:53:00 devstack cinder-volume[82690]: INFO oslo_service.backend._eventlet.service [None req-76b3c6cc-7319-457d-b94f-9a54cd05f608 None None] Child 82841 exited with status 0 Aug 26 02:53:01 devstack cinder-volume[92998]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 02:53:01 devstack cinder-volume[92998]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 02:53:01 devstack cinder-volume[92998]: we strongly recommend against using it for new projects. Aug 26 02:53:01 devstack cinder-volume[92998]: If you are already using Eventlet, we recommend migrating to a different Aug 26 02:53:01 devstack cinder-volume[92998]: framework. For more detail see Aug 26 02:53:01 devstack cinder-volume[92998]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 02:53:01 devstack cinder-volume[92998]: import eventlet # noqa Aug 26 02:53:03 devstack cinder-volume[92998]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:53:03 devstack cinder-volume[92998]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:53:03 devstack cinder-volume[92998]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:53:04 devstack cinder-volume[92998]: INFO dbcounter [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Registered counter for database cinder Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92998) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG dbcounter [-] [92998] Writer thread running {{(pid=92998) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:53:04 devstack cinder-volume[92998]: INFO cinder.rpc [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 02:53:04 devstack cinder-volume[92998]: INFO cinder.rpc [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92998) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:53:04 devstack cinder-volume[92998]: INFO cinder.volume.manager [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Determined volume DB was empty at startup. Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG cinder.volume.manager [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92998) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 02:53:04 devstack cinder-volume[92998]: INFO cinder.volume.manager [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 02:53:04 devstack cinder-volume[92998]: WARNING stevedore.named [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 02:53:04 devstack cinder-volume[92998]: WARNING castellan.key_manager [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:53:04 devstack cinder-volume[92998]: WARNING cinder.keymgr.conf_key_mgr [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:53:04 devstack cinder-volume[92998]: INFO cinder.volume.manager [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92998) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:53:04 devstack cinder-volume[92998]: INFO oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Starting 1 workers Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Started child 93214 {{(pid=92998) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Full set of CONF: {{(pid=92998) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] ******************************************************************************** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Configuration options gathered from: {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] ================================================================================ {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] allow_availability_zone_fallback = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] allow_compression_on_image_upload = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] allowed_direct_url_schemes = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[93214]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] api_rate_limit = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] auth_strategy = keystone {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_availability_zone = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_host = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_stats_polling_interval = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backup_api_class = cinder.backup.api.API {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backup_name_template = backup-%s {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backup_use_same_host = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backup_use_temp_snapshot = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] chap_password = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] chap_username = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_internal_tenant_project_id = f5511e849ef5418bb3a5247379589052 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_internal_tenant_user_id = d5e5d82b40a44d16b3d48f62f4ff95b9 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cluster = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] compression_format = gzip {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] compute_api_class = cinder.compute.nova.API {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] config_dir = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] config_source = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] control_exchange = openstack {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] debug = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] default_availability_zone = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] default_group_type = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] default_volume_type = QuobyteHD {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] disk_geometry = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] driver_client_cert = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] driver_client_cert_key = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] driver_data_namespace = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] driver_ssl_cert_path = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] driver_ssl_cert_verify = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] driver_use_ssl = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] enable_new_services = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] enable_unsupported_driver = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] enabled_backends = ['QuobyteHD'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] enforce_multipath_for_image_xfer = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] filter_function = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_api_insecure = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_api_ssl_compression = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_ca_certificates_file = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_catalog_info = image:glance:publicURL {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_certfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_keyfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_num_retries = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance_request_timeout = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] goodness_function = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] graceful_shutdown_timeout = 5 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] group_api_class = cinder.group.api.API {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] host = devstack {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_compress_on_upload = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_conversion_address_space_limit = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_conversion_cpu_limit = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_conversion_disable = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:04 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_upload_use_cinder_backend = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_upload_use_internal_tenant = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_volume_cache_enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_volume_cache_max_count = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] image_volume_cache_max_size_gb = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] init_host_max_objects_retrieval = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] instance_format = [instance: %(uuid)s] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] iscsi_target_flags = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] iscsi_write_cache = on {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] iser_helper = tgtadm {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] iser_ip_address = 192.168.122.13 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] iser_port = 3260 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_color = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_config_append = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_dir = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_file = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[93214]: INFO cinder.volume.manager [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG cinder.volume.drivers.remotefs [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93214) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_options = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_rotate_interval = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_rotate_interval_type = days {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] log_rotation_type = none {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] max_age = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] max_logfile_count = 30 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] max_logfile_size_mb = 200 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] max_over_subscription_ratio = 20.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] message_reap_interval = 86400 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] message_ttl = 2592000 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] migration_create_volume_timeout_secs = 300 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] monkey_patch = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] monkey_patch_modules = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] my_ip = 192.168.122.13 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] no_snapshot_gb_quota = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] num_iser_scan_tries = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] num_shell_tries = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] num_volume_device_scan_tries = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] nvmeof_conn_info_version = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] nvmet_ns_id = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] nvmet_port_id = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] osapi_max_limit = 1000 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] osapi_volume_ext_list = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] osapi_volume_listen = 0.0.0.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] osapi_volume_listen_port = 8776 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] osapi_volume_use_ssl = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] osapi_volume_workers = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] per_volume_size_limit = -1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] periodic_fuzzy_delay = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] periodic_interval = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] project_id_regex = [0-9a-f\-]+ {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] public_endpoint = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] publish_errors = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] quota_backup_gigabytes = 1000 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] quota_backups = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] quota_gigabytes = 1000 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] quota_groups = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] quota_snapshots = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] quota_volumes = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] rate_limit_burst = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] rate_limit_except_level = CRITICAL {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] rate_limit_interval = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] reinit_driver_count = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] replication_device = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] report_discard_supported = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] report_interval = 120 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] reservation_clean_interval = 86400 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] reservation_expire = 86400 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] reserved_image_namespaces = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] reserved_percentage = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] rpc_response_timeout = 120 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] run_external_periodic_tasks = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] scst_target_driver = iscsi {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] scst_target_iqn_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_down_time = 720 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] shell_completion = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] snapshot_name_template = snapshot-%s {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] split_loggers = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] state_path = /opt/stack/data/cinder {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] storage_availability_zone = nova {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] storage_protocol = iSCSI {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] syslog_log_facility = LOG_USER {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] target_helper = lioadm {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] target_ip_address = 192.168.122.13 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] target_port = 3260 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] target_protocol = iscsi {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] target_secondary_ip_addresses = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] trace_flags = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] transfer_api_class = cinder.transfer.api.API {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] transport_url = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] until_refresh = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93214) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 02:53:05 devstack cinder-volume[93214]: WARNING cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 02:53:05 devstack cinder-volume[93214]: WARNING cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Running cmd (subprocess): mount.quobyte {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] use_chap_auth = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] use_default_quota_class = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] use_journal = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] use_json = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] use_multipath_for_image_xfer = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] use_stderr = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] use_syslog = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] verify_glance_signatures = enabled {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_api_class = cinder.volume.api.API {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_backend_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_clear = zero {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_clear_ionice = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_clear_size = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_copy_bps_limit = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_dd_blocksize = 1M {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_name_template = volume-%s {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_service_inithost_offload = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volume_usage_audit_period = month {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] zoning_mode = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_concurrency.disable_process_locking = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.auth_section = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.auth_type = password {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.auth_version = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.cache = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.certfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.delay_auth_decision = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.http_connect_timeout = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.include_service_catalog = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.insecure = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.interface = public {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.keyfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_password = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcache_username = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.region_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.service_token_roles_required = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.service_type = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.token_cache_time = 300 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.backend = dogpile.cache.null {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.backend_argument = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.backend_expiration_time = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.config_prefix = cache.oslo {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.debug_cache_backend = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.enable_retry_client = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.enable_socket_keepalive = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.expiration_time = 600 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.hashclient_retry_attempts = 2 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.memcache_dead_retry = 300 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.memcache_pool_maxsize = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.memcache_sasl_enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.password = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.proxies = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.redis_db = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.redis_sentinel_service_name = mymaster {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack quobyte-client[93215]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 02:53:05 devstack quobyte-client[93215]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.redis_server = localhost:6379 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.retry_attempts = 2 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.retry_delay = 0.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.socket_keepalive_count = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.socket_keepalive_idle = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.socket_keepalive_interval = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:53:05 devstack cinder-volume[93214]: INFO cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b ... Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 -c /etc/quobyte/client-cinder.cfg {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.socket_timeout = 1.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.tls_allowed_ciphers = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.tls_cafile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.tls_certfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.tls_enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.tls_keyfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cache.username = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] coordination.backend_url = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.asyncio_connection = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.asyncio_slave_connection = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.backend = sqlalchemy {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.connection = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.connection_debug = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.connection_parameters = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.connection_recycle_time = 3600 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.connection_trace = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.db_inc_retry_interval = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.db_max_retries = 20 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.db_max_retry_interval = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.db_retry_interval = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.max_overflow = 50 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.max_pool_size = 5 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.max_retries = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.mysql_wsrep_sync_wait = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.pool_timeout = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.retry_interval = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.slave_connection = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.sqlite_synchronous = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.synchronous_reader = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] database.use_db_reconnect = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 -c /etc/quobyte/client-cinder.cfg Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.connection_string = messaging:// {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.es_doc_type = notification {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.es_scroll_size = 10000 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.es_scroll_time = 2m {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.filter_error_trace = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.hmac_keys = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.sentinel_service_name = mymaster {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.socket_timeout = 0.1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.trace_requests = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler.trace_sqlalchemy = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler_jaeger.process_tags = {} {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler_jaeger.service_name_prefix = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] profiler_otlp.service_name_prefix = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.enforce_new_defaults = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.policy_default_rule = default {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.policy_file = policy.yaml {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_policy.remote_timeout = 60.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] privsep_osbrick.group = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] privsep_osbrick.helper_command = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] privsep_osbrick.user = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_sys_admin.group = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_sys_admin.helper_command = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] cinder_sys_admin.user = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.auth_section = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.auth_type = password {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.cafile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.certfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.collect_timing = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.insecure = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.keyfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.send_service_user_token = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.split_loggers = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] service_user.timeout = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.auth_section = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.auth_type = password {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.certfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.collect_timing = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.insecure = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.keyfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.region_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.split_loggers = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] glance.timeout = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.backend_availability_zone = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.chap_password = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.chap_username = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.disk_geometry = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.driver_client_cert = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.driver_client_cert_key = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.driver_data_namespace = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.driver_use_ssl = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.enable_unsupported_driver = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.extra_capabilities = {} {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.filter_function = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.goodness_function = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.iscsi_target_flags = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.iscsi_write_cache = on {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.iser_helper = tgtadm {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.iser_port = 3260 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_host = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_login = admin {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_mount_options = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_password = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_private_key = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_share_path = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_ssh_port = 22 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.num_shell_tries = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.nvmet_port_id = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.quobyte_client_cfg = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.quobyte_volume_url = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.replication_device = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.report_discard_supported = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.reserved_percentage = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.scst_target_driver = iscsi {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.scst_target_iqn_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.storage_protocol = iSCSI {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.target_helper = tgtadm {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.target_port = 3260 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.target_protocol = iscsi {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.trace_flags = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.unique_fqdn_network = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.use_chap_auth = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volume_backend_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volume_clear = zero {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volume_clear_ionice = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volume_clear_size = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_reports.file_event_handler = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_reports.log_dir = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.backend_availability_zone = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.backend_host = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.chap_password = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.chap_username = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.chiscsi_conf = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.disk_geometry = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.driver_client_cert = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.driver_client_cert_key = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.driver_data_namespace = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.driver_use_ssl = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.extra_capabilities = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.filter_function = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.goodness_function = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.iscsi_target_flags = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.iscsi_write_cache = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.iser_helper = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.iser_ip_address = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.iser_port = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.iser_target_prefix = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_host = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_login = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_mount_options = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_password = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_private_key = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_share_path = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_ssh_port = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.num_shell_tries = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nvmet_ns_id = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.nvmet_port_id = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.replication_device = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.report_discard_supported = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.reserved_percentage = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.scst_target_driver = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.storage_protocol = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.target_helper = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.target_ip_address = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.target_port = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.target_prefix = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.target_protocol = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.trace_flags = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.unique_fqdn_network = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.use_chap_auth = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volume_clear = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volume_clear_ionice = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volume_clear_size = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] QuobyteHD.volumes_dir = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.ssl = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.ssl_version = {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_notifications.driver = [] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_notifications.retry = -1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] oslo_messaging_notifications.transport_url = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] key_manager.fixed_key = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.barbican_api_version = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.barbican_endpoint = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.barbican_endpoint_type = public {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.barbican_region_name = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.cafile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.certfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.collect_timing = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.insecure = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.keyfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.number_of_retries = 60 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.retry_delay = 1 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.send_service_user_token = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.split_loggers = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.timeout = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.verify_ssl = True {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican.verify_ssl_path = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.auth_section = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.auth_type = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.cafile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.certfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.collect_timing = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.insecure = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.keyfile = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.split_loggers = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] barbican_service_user.timeout = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.approle_role_id = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.approle_secret_id = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.auth_method = approle {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.auth_path = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.kv_mountpoint = secret {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.kv_path = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.kv_version = 2 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.namespace = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.root_token_id = **** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.ssl_ca_crt_file = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.timeout = 60.0 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.token_file = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.token_role = None {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.use_ssl = False {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:05 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] ******************************************************************************** {{(pid=92998) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 02:53:05 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.466s {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:05 devstack cinder-volume[93214]: INFO cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b succeeded Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.477s {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:05 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:53:05 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:05 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.323s {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:05 devstack cinder-volume[93214]: INFO cinder.volume.driver [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 02:53:05 devstack cinder-volume[93214]: DEBUG cinder.volume.driver [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8831176757812, 'free_capacity_gb': 1774.8831176757812, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93214) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_db.sqlalchemy.engines [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG dbcounter [-] [93214] Writer thread running {{(pid=93214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.db.api [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Building query based on filter {{(pid=93214) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.image.image_utils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93214) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 02:53:06 devstack cinder-volume[93214]: INFO cinder.keymgr.migration [None req-8c4e731b-d264-4acc-8056-cd328f58503b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:06 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:53:06 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:06 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.269s {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.manager [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Notifying Schedulers of capabilities ... {{(pid=93214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:53:06 devstack cinder-volume[93214]: INFO cinder.volume.manager [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Driver initialization completed successfully. Aug 26 02:53:06 devstack cinder-volume[93214]: INFO cinder.manager [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Initiating service 3 cleanup Aug 26 02:53:06 devstack cinder-volume[93214]: INFO cinder.manager [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Service 3 cleanup completed. Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.service [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Creating RPC server for service cinder-volume {{(pid=93214) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.service [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93214) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 02:53:06 devstack cinder-volume[93214]: INFO cinder.volume.manager [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93214) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG cinder.volume.drivers.quobyte [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93214) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93214) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:53:06 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:06 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:53:06 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:07 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:07 devstack cinder-volume[93214]: DEBUG oslo_concurrency.processutils [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.447s {{(pid=93214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:07 devstack cinder-volume[93214]: INFO cinder.volume.manager [None req-a6db166e-6ad2-4bd9-8f72-1a9960778789 None None] Driver post RPC initialization completed successfully. Aug 26 02:53:11 devstack cinder-volume[92998]: INFO oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Caught SIGTERM, stopping children Aug 26 02:53:11 devstack cinder-volume[92998]: DEBUG oslo_concurrency.lockutils [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Acquiring lock "singleton_lock" {{(pid=92998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:53:11 devstack cinder-volume[92998]: DEBUG oslo_concurrency.lockutils [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Acquired lock "singleton_lock" {{(pid=92998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:53:11 devstack cinder-volume[92998]: DEBUG oslo_concurrency.lockutils [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Releasing lock "singleton_lock" {{(pid=92998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:53:11 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Stop services. {{(pid=92998) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 02:53:11 devstack cinder-volume[92998]: DEBUG oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Killing children. {{(pid=92998) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 02:53:11 devstack cinder-volume[92998]: INFO oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Waiting on 1 children to exit Aug 26 02:53:14 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Acquiring lock "singleton_lock" {{(pid=93214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:53:14 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Acquired lock "singleton_lock" {{(pid=93214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:53:14 devstack cinder-volume[93214]: DEBUG oslo_concurrency.lockutils [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Releasing lock "singleton_lock" {{(pid=93214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:53:14 devstack cinder-volume[93214]: WARNING amqp [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 02:53:14 devstack cinder-volume[93214]: WARNING amqp [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 02:53:14 devstack cinder-volume[92998]: INFO oslo_service.backend._eventlet.service [None req-f8ef45e3-96c1-4322-bd36-1c2912f089dd None None] Child 93214 exited with status 0 Aug 26 02:53:15 devstack cinder-volume[93493]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 02:53:15 devstack cinder-volume[93493]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 02:53:15 devstack cinder-volume[93493]: we strongly recommend against using it for new projects. Aug 26 02:53:15 devstack cinder-volume[93493]: If you are already using Eventlet, we recommend migrating to a different Aug 26 02:53:15 devstack cinder-volume[93493]: framework. For more detail see Aug 26 02:53:15 devstack cinder-volume[93493]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 02:53:15 devstack cinder-volume[93493]: import eventlet # noqa Aug 26 02:53:18 devstack cinder-volume[93493]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:53:18 devstack cinder-volume[93493]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:53:18 devstack cinder-volume[93493]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:53:19 devstack cinder-volume[93493]: INFO dbcounter [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Registered counter for database cinder Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_db.sqlalchemy.engines [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93493) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG dbcounter [-] [93493] Writer thread running {{(pid=93493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:53:19 devstack cinder-volume[93493]: INFO cinder.rpc [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 02:53:19 devstack cinder-volume[93493]: INFO cinder.rpc [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_db.sqlalchemy.engines [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93493) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:53:19 devstack cinder-volume[93493]: INFO cinder.volume.manager [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Determined volume DB was empty at startup. Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG cinder.volume.manager [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93493) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 02:53:19 devstack cinder-volume[93493]: WARNING stevedore.named [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 02:53:19 devstack cinder-volume[93493]: WARNING castellan.key_manager [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:53:19 devstack cinder-volume[93493]: WARNING cinder.keymgr.conf_key_mgr [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:53:19 devstack cinder-volume[93493]: INFO cinder.volume.manager [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_db.sqlalchemy.engines [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93493) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:53:19 devstack cinder-volume[93493]: INFO oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Starting 1 workers Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Started child 93797 {{(pid=93493) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Full set of CONF: {{(pid=93493) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] ******************************************************************************** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] Configuration options gathered from: {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] ================================================================================ {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] allow_availability_zone_fallback = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] allow_compression_on_image_upload = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] allowed_direct_url_schemes = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] api_rate_limit = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] auth_strategy = keystone {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93797]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_availability_zone = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_host = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_stats_polling_interval = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backup_api_class = cinder.backup.api.API {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backup_name_template = backup-%s {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backup_use_same_host = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backup_use_temp_snapshot = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] chap_password = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] chap_username = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_internal_tenant_project_id = f5511e849ef5418bb3a5247379589052 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_internal_tenant_user_id = d5e5d82b40a44d16b3d48f62f4ff95b9 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cluster = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] compression_format = gzip {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] compute_api_class = cinder.compute.nova.API {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] config_dir = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] config_source = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] control_exchange = openstack {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] debug = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] default_availability_zone = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] default_group_type = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] default_volume_type = QuobyteHD {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] disk_geometry = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] driver_client_cert = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] driver_client_cert_key = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] driver_data_namespace = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] driver_ssl_cert_path = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] driver_ssl_cert_verify = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] driver_use_ssl = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] enable_new_services = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] enable_unsupported_driver = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] enabled_backends = ['QuobyteHD'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] enforce_multipath_for_image_xfer = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] filter_function = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_api_insecure = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_api_ssl_compression = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_ca_certificates_file = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_catalog_info = image:glance:publicURL {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_certfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_keyfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_num_retries = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance_request_timeout = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] goodness_function = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] graceful_shutdown_timeout = 5 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] group_api_class = cinder.group.api.API {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] host = devstack {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_compress_on_upload = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_conversion_address_space_limit = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_conversion_cpu_limit = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_conversion_disable = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_upload_use_cinder_backend = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_upload_use_internal_tenant = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_volume_cache_enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_volume_cache_max_count = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] image_volume_cache_max_size_gb = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] init_host_max_objects_retrieval = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] instance_format = [instance: %(uuid)s] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] iscsi_target_flags = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] iscsi_write_cache = on {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] iser_helper = tgtadm {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] iser_ip_address = 192.168.122.13 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] iser_port = 3260 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_color = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_config_append = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93797) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_dir = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_file = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_options = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_rotate_interval = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_rotate_interval_type = days {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] log_rotation_type = none {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] max_age = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] max_logfile_count = 30 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] max_logfile_size_mb = 200 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] max_over_subscription_ratio = 20.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] message_reap_interval = 86400 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] message_ttl = 2592000 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] migration_create_volume_timeout_secs = 300 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] monkey_patch = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] monkey_patch_modules = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] my_ip = 192.168.122.13 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] no_snapshot_gb_quota = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] num_iser_scan_tries = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] num_shell_tries = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] num_volume_device_scan_tries = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] nvmeof_conn_info_version = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] nvmet_ns_id = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] nvmet_port_id = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] osapi_max_limit = 1000 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] osapi_volume_ext_list = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] osapi_volume_listen_port = 8776 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] osapi_volume_use_ssl = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] osapi_volume_workers = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] per_volume_size_limit = -1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] periodic_fuzzy_delay = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] periodic_interval = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] public_endpoint = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] publish_errors = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] quota_backup_gigabytes = 1000 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] quota_backups = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] quota_gigabytes = 1000 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] quota_groups = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] quota_snapshots = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] quota_volumes = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] rate_limit_burst = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] rate_limit_except_level = CRITICAL {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] rate_limit_interval = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] reinit_driver_count = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] replication_device = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] report_discard_supported = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] report_interval = 120 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] reservation_clean_interval = 86400 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] reservation_expire = 86400 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] reserved_image_namespaces = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] reserved_percentage = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] rpc_response_timeout = 120 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] run_external_periodic_tasks = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] scst_target_driver = iscsi {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] scst_target_iqn_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_down_time = 720 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] shell_completion = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] snapshot_name_template = snapshot-%s {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] split_loggers = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] state_path = /opt/stack/data/cinder {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] storage_availability_zone = nova {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] storage_protocol = iSCSI {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] syslog_log_facility = LOG_USER {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] target_helper = lioadm {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] target_ip_address = 192.168.122.13 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] target_port = 3260 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] target_protocol = iscsi {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] target_secondary_ip_addresses = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] trace_flags = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] transport_url = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] until_refresh = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] use_chap_auth = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] use_default_quota_class = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] use_journal = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] use_json = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] use_multipath_for_image_xfer = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] use_stderr = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] use_syslog = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] verify_glance_signatures = enabled {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_api_class = cinder.volume.api.API {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_backend_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_clear = zero {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_clear_ionice = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_clear_size = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_copy_bps_limit = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_dd_blocksize = 1M {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_name_template = volume-%s {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_service_inithost_offload = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volume_usage_audit_period = month {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] zoning_mode = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_concurrency.disable_process_locking = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.auth_section = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.auth_type = password {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.auth_version = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.cache = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.certfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.include_service_catalog = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.insecure = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.interface = public {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.keyfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_password = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcache_username = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.region_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.service_type = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93797) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.backend = dogpile.cache.null {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 02:53:19 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.backend_argument = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.backend_expiration_time = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.config_prefix = cache.oslo {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.debug_cache_backend = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.enable_retry_client = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.enable_socket_keepalive = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Running cmd (subprocess): mount.quobyte {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.expiration_time = 600 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.hashclient_retry_attempts = 2 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.memcache_dead_retry = 300 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.memcache_pool_maxsize = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.memcache_sasl_enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.password = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.proxies = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.redis_db = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.redis_server = localhost:6379 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.retry_attempts = 2 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.retry_delay = 0.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.socket_keepalive_count = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.socket_keepalive_idle = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.socket_keepalive_interval = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.socket_timeout = 1.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.tls_allowed_ciphers = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.tls_cafile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.tls_certfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.tls_enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.tls_keyfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cache.username = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] coordination.backend_url = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.asyncio_connection = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.asyncio_slave_connection = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.backend = sqlalchemy {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.connection = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.connection_debug = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.connection_parameters = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.connection_recycle_time = 3600 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.connection_trace = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.db_inc_retry_interval = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.db_max_retries = 20 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.db_max_retry_interval = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.db_retry_interval = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.max_overflow = 50 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.max_pool_size = 5 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.max_retries = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.mysql_wsrep_sync_wait = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.pool_timeout = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.retry_interval = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.slave_connection = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.sqlite_synchronous = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.synchronous_reader = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] database.use_db_reconnect = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.connection_string = messaging:// {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.es_doc_type = notification {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.es_scroll_size = 10000 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.es_scroll_time = 2m {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.filter_error_trace = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.hmac_keys = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.sentinel_service_name = mymaster {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.socket_timeout = 0.1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.trace_requests = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler.trace_sqlalchemy = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler_jaeger.process_tags = {} {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler_jaeger.service_name_prefix = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] profiler_otlp.service_name_prefix = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.enforce_new_defaults = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.policy_default_rule = default {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.policy_file = policy.yaml {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] privsep_osbrick.group = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] privsep_osbrick.helper_command = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] privsep_osbrick.user = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_sys_admin.group = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_sys_admin.helper_command = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] cinder_sys_admin.user = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.auth_section = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.auth_type = password {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.cafile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.certfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.collect_timing = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.insecure = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.keyfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.send_service_user_token = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.split_loggers = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] service_user.timeout = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.auth_section = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.auth_type = password {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.certfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.collect_timing = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.insecure = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.keyfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.region_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack quobyte-client[93798]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 02:53:19 devstack quobyte-client[93798]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.split_loggers = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] glance.timeout = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.backend_availability_zone = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.chap_password = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.chap_username = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.disk_geometry = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.driver_client_cert = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.driver_client_cert_key = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.driver_data_namespace = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.driver_use_ssl = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.extra_capabilities = {} {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.filter_function = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.goodness_function = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.iscsi_target_flags = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.iscsi_write_cache = on {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.iser_helper = tgtadm {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.iser_port = 3260 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_host = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_login = admin {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_mount_options = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_password = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_private_key = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_share_path = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.num_shell_tries = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.quobyte_volume_url = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.replication_device = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.report_discard_supported = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.reserved_percentage = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:53:19 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.target_helper = tgtadm {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.target_port = 3260 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.target_protocol = iscsi {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.trace_flags = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.unique_fqdn_network = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.use_chap_auth = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volume_backend_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volume_clear = zero {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volume_clear_ionice = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volume_clear_size = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_reports.file_event_handler = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_reports.log_dir = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.backend_availability_zone = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.backend_host = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.chap_password = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.chap_username = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.chiscsi_conf = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.disk_geometry = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.driver_client_cert = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.driver_data_namespace = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.driver_use_ssl = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.extra_capabilities = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.filter_function = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.goodness_function = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.iser_helper = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.iser_ip_address = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.iser_port = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.iser_target_prefix = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_host = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_login = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_mount_options = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_password = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_private_key = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_share_path = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_ssh_port = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.num_shell_tries = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.nvmet_port_id = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.replication_device = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.report_discard_supported = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.reserved_percentage = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.scst_target_driver = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.storage_protocol = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.target_helper = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.target_ip_address = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.target_port = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.target_prefix = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.target_protocol = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.trace_flags = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.use_chap_auth = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volume_clear = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volume_clear_size = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] QuobyteHD.volumes_dir = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:19 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.ssl = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_notifications.driver = [] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_notifications.retry = -1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] key_manager.fixed_key = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.barbican_api_version = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.barbican_endpoint = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.barbican_endpoint_type = public {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.barbican_region_name = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.cafile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.certfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.collect_timing = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.insecure = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.keyfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.number_of_retries = 60 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.retry_delay = 1 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.send_service_user_token = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.split_loggers = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.timeout = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.verify_ssl = True {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican.verify_ssl_path = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.auth_section = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.auth_type = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.cafile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.certfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.collect_timing = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.insecure = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.keyfile = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.split_loggers = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] barbican_service_user.timeout = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.approle_role_id = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.approle_secret_id = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.auth_method = approle {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.auth_path = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.kv_mountpoint = secret {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.kv_path = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.kv_version = 2 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.namespace = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.root_token_id = **** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.ssl_ca_crt_file = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.timeout = 60.0 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.token_file = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.token_role = None {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.use_ssl = False {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:53:20 devstack cinder-volume[93493]: DEBUG oslo_service.backend._eventlet.service [None req-e54de115-f352-492b-871d-7bfd7efe2324 None None] ******************************************************************************** {{(pid=93493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 02:53:20 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.243s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:20 devstack cinder-volume[93797]: INFO cinder.volume.driver [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.volume.driver [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.883586883545, 'free_capacity_gb': 1774.883586883545, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93797) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_db.sqlalchemy.engines [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writer thread running {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.db.api [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Building query based on filter {{(pid=93797) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93797) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:20 devstack cinder-volume[93797]: INFO cinder.keymgr.migration [None req-8e5b8c75-8d79-4e42-9f44-e0d8dac5b6fd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 02:53:20 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:53:20 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:20 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.234s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:53:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Driver initialization completed successfully. Aug 26 02:53:20 devstack cinder-volume[93797]: INFO cinder.manager [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Initiating service 3 cleanup Aug 26 02:53:20 devstack cinder-volume[93797]: INFO cinder.manager [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Service 3 cleanup completed. Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.service [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Creating RPC server for service cinder-volume {{(pid=93797) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.service [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93797) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 02:53:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:20 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:53:20 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:20 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.253s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a9370025-d7f9-47f4-bdc1-00b39d70b951 None None] Driver post RPC initialization completed successfully. Aug 26 02:53:29 devstack cinder-volume[93493]: DEBUG dbcounter [-] [93493] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:53:30 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:53:30 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=3 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:54:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:54:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 6 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:54:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Flow 'volume_create_manager' (e874f7bb-9857-4645-9c9e-55870c4eca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab15bca6-3da3-479e-b748-5b67b0104575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab15bca6-3da3-479e-b748-5b67b0104575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1037197169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a36d8e0-a7c2-4005-9d34-cde31129968e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8731dbbc4ce45cbb4b9070a1e66ffe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:55:00Z,use_quota=True,user_id='aeeadfaf7eda489c8d77443bb2796835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2f1251-ecfe-4cc7-9df3-630122a58bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2f1251-ecfe-4cc7-9df3-630122a58bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bcfb6f-8e05-44e7-b210-98e4e5b79994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bcfb6f-8e05-44e7-b210-98e4e5b79994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a36d8e0-a7c2-4005-9d34-cde31129968e', 'volume_name': 'volume-4a36d8e0-a7c2-4005-9d34-cde31129968e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8edb94cd-6c67-49aa-b43a-9d41280e75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8edb94cd-6c67-49aa-b43a-9d41280e75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843dc6ae-420f-46df-966b-d9756ff72267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:00 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Volume 4a36d8e0-a7c2-4005-9d34-cde31129968e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a36d8e0-a7c2-4005-9d34-cde31129968e', 'volume_size': 1} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1037197169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a36d8e0-a7c2-4005-9d34-cde31129968e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8731dbbc4ce45cbb4b9070a1e66ffe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:55:00Z,use_quota=True,user_id='aeeadfaf7eda489c8d77443bb2796835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Creating volume 4a36d8e0-a7c2-4005-9d34-cde31129968e {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:55:00 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:55:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:00 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e 1073741824 Aug 26 02:55:00 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:55:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:02 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:55:02 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:02 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e 1073741824" returned: 0 in 1.962s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:03 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e Aug 26 02:55:03 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:03 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 1.086s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 6 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:55:03 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e" returned: 0 in 0.570s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] <== create_volume: return (2780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.787s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843dc6ae-420f-46df-966b-d9756ff72267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a36d8e0-a7c2-4005-9d34-cde31129968e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91d298d-4217-40d5-b4e5-76f814b41391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:03 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Volume volume-4a36d8e0-a7c2-4005-9d34-cde31129968e (4a36d8e0-a7c2-4005-9d34-cde31129968e): created successfully Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91d298d-4217-40d5-b4e5-76f814b41391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Flow 'volume_create_manager' (e874f7bb-9857-4645-9c9e-55870c4eca4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:55:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-fce9d3b2-600f-405e-b85f-81185d96471d tempest-VolumesAdminNegativeTest-169829432 None] Created volume successfully. Aug 26 02:55:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Acquiring lock "cinder-4a36d8e0-a7c2-4005-9d34-cde31129968e-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:55:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Lock "cinder-4a36d8e0-a7c2-4005-9d34-cde31129968e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:55:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Acquiring lock "cinder-quobyte-4a36d8e0-a7c2-4005-9d34-cde31129968e" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:55:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Lock "cinder-quobyte-4a36d8e0-a7c2-4005-9d34-cde31129968e" acquired by "delete_volume" :: waited 0.046s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:55:06 devstack cinder-volume[93797]: INFO oslo.privsep.daemon [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4jpncc98/privsep.sock'] Aug 26 02:55:06 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4jpncc98/privsep.sock Aug 26 02:55:06 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Flow 'volume_create_manager' (984faec5-2961-44f6-a6bf-c4f49d4b99bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98209984-68fc-4199-88b3-6342175b9a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98209984-68fc-4199-88b3-6342175b9a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-541029514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd66fd6-de00-4e05-9142-5f2e650f8141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c83fc7e4de0409497b087e364c0962c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:55:07Z,use_quota=True,user_id='385cb448da0a442aabf2c94771f3e2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4074d83a-9ded-4b38-9c5c-ad3cba4935ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4074d83a-9ded-4b38-9c5c-ad3cba4935ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27986a81-ffd4-456a-9288-fddd834c7b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27986a81-ffd4-456a-9288-fddd834c7b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd66fd6-de00-4e05-9142-5f2e650f8141', 'volume_name': 'volume-0cd66fd6-de00-4e05-9142-5f2e650f8141', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e2ef53-80e5-4611-ac2e-e17b4f398892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e2ef53-80e5-4611-ac2e-e17b4f398892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5583d56-36a6-4f99-8e3d-91fb85fab24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:07 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Volume 0cd66fd6-de00-4e05-9142-5f2e650f8141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd66fd6-de00-4e05-9142-5f2e650f8141', 'volume_size': 1} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-541029514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd66fd6-de00-4e05-9142-5f2e650f8141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c83fc7e4de0409497b087e364c0962c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:55:07Z,use_quota=True,user_id='385cb448da0a442aabf2c94771f3e2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Creating volume 0cd66fd6-de00-4e05-9142-5f2e650f8141 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:55:07 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:55:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:07 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 1073741824 Aug 26 02:55:07 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 02:55:08 devstack cinder-volume[93797]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 26 02:55:08 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:08 devstack cinder-volume[93797]: INFO oslo.privsep.daemon [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Spawned new privsep daemon via rootwrap Aug 26 02:55:08 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Accepted privsep connection to /tmp/tmp4jpncc98/privsep.sock {{(pid=93797) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 26 02:55:08 devstack cinder-volume[93797]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 26 02:55:08 devstack cinder-volume[93797]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 26 02:55:08 devstack cinder-volume[93797]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 26 02:55:08 devstack cinder-volume[93797]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95175 Aug 26 02:55:08 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c255ef56-928e-498d-917b-60a71aa0a91c]: (2,) {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:55:08 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 1073741824" returned: 0 in 0.996s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:08 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ffacc-7a55-408f-842d-27af9194c92e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:55:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:08 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 Aug 26 02:55:08 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:08 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e Aug 26 02:55:08 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:09 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e" returned: 0 in 0.634s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:09 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e Aug 26 02:55:09 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:09 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141" returned: 0 in 0.691s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5583d56-36a6-4f99-8e3d-91fb85fab24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd66fd6-de00-4e05-9142-5f2e650f8141', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f4b4d2-c388-4f27-8e5a-7fe27604bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Volume volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 (0cd66fd6-de00-4e05-9142-5f2e650f8141): created successfully Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f4b4d2-c388-4f27-8e5a-7fe27604bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Flow 'volume_create_manager' (984faec5-2961-44f6-a6bf-c4f49d4b99bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:55:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3030ac3b-f396-415f-8241-73cb962f6547 tempest-ServerRescueNegativeTestJSON-368308817 None] Created volume successfully. Aug 26 02:55:09 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4a36d8e0-a7c2-4005-9d34-cde31129968e" returned: 0 in 0.544s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Lock "cinder-quobyte-4a36d8e0-a7c2-4005-9d34-cde31129968e" released by "delete_volume" :: held 3.807s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:55:09 devstack cinder-volume[93797]: WARNING cinder.quota [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:55:09 devstack cinder-volume[93797]: WARNING cinder.quota [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Created reservations ['118048ff-56d8-4bdd-bdfd-478d7980e7e4', '4661c7c1-1a9a-465b-b0b4-b4ead57ecbac', '8d2f4454-b983-4e34-a384-9bb1a7b54208', '7e0bd202-d571-444e-b51a-28bd614c0a63'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:10 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:55:10 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:10 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.583s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:55:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Deleted volume successfully. Aug 26 02:55:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-79c0b3d7-5b19-45d1-bae6-cca77a79dac2 tempest-VolumesAdminNegativeTest-169829432 None] Lock "cinder-4a36d8e0-a7c2-4005-9d34-cde31129968e-delete_volume" released by "delete_volume" :: held 4.945s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:55:20 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:55:20 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Flow 'volume_create_manager' (b92a9173-bcd4-4ea7-a39c-e8ba7692a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd06a5c-a763-430a-94c6-1a2dc3b6f8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd06a5c-a763-430a-94c6-1a2dc3b6f8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-990340989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5237273-7ada-465d-9a39-dc48209db5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbd996413ab40e6b1fe27edfed67e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:55:25Z,use_quota=True,user_id='983ebdb7f0c641a2939a87f2617965ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93ea5dd-1efc-4b8c-ae1f-7c04d96fefbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93ea5dd-1efc-4b8c-ae1f-7c04d96fefbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe2d287-e8b8-49d5-9626-d1b5fb6a2463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe2d287-e8b8-49d5-9626-d1b5fb6a2463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5237273-7ada-465d-9a39-dc48209db5b1', 'volume_name': 'volume-f5237273-7ada-465d-9a39-dc48209db5b1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450f9b12-0a4f-4f92-9d39-cf56600c2d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450f9b12-0a4f-4f92-9d39-cf56600c2d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9813414-7891-4d9f-ab7c-5a8aacd65116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:24 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Volume f5237273-7ada-465d-9a39-dc48209db5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5237273-7ada-465d-9a39-dc48209db5b1', 'volume_size': 1} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-990340989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5237273-7ada-465d-9a39-dc48209db5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbd996413ab40e6b1fe27edfed67e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:55:25Z,use_quota=True,user_id='983ebdb7f0c641a2939a87f2617965ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Creating volume f5237273-7ada-465d-9a39-dc48209db5b1 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:55:24 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:55:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:25 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 1073741824 Aug 26 02:55:25 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:25 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 1073741824" returned: 0 in 0.968s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:26 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 Aug 26 02:55:26 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:26 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1" returned: 0 in 0.398s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:55:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9813414-7891-4d9f-ab7c-5a8aacd65116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5237273-7ada-465d-9a39-dc48209db5b1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43f12f9-a755-4253-98da-5c1745e6c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:26 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Volume volume-f5237273-7ada-465d-9a39-dc48209db5b1 (f5237273-7ada-465d-9a39-dc48209db5b1): created successfully Aug 26 02:55:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43f12f9-a755-4253-98da-5c1745e6c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Flow 'volume_create_manager' (b92a9173-bcd4-4ea7-a39c-e8ba7692a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:55:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-656234cf-91dd-4831-9b07-4a03b4d33e2c tempest-ServerActionsTestOtherA-958777878 None] Created volume successfully. Aug 26 02:55:36 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:55:36 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:55:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Acquiring lock "cinder-0cd66fd6-de00-4e05-9142-5f2e650f8141-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:55:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "cinder-0cd66fd6-de00-4e05-9142-5f2e650f8141-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:55:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Acquiring lock "cinder-quobyte-0cd66fd6-de00-4e05-9142-5f2e650f8141" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:55:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "cinder-quobyte-0cd66fd6-de00-4e05-9142-5f2e650f8141" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:55:43 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea93903-eb73-4af9-9281-ac0e848ff5ef]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:55:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:44 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 Aug 26 02:55:44 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:44 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141" returned: 0 in 0.618s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:44 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141 Aug 26 02:55:44 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:45 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0cd66fd6-de00-4e05-9142-5f2e650f8141" returned: 0 in 0.470s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "cinder-quobyte-0cd66fd6-de00-4e05-9142-5f2e650f8141" released by "delete_volume" :: held 1.207s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Created reservations ['996c1ca6-0278-4d1e-9aed-8b41bdc9ac0c', 'db928a7a-7a19-4193-b2a8-11299bfde90f', '6b3ccbd4-fd3f-4d85-9456-046fbb8bae48', 'a3bd0d3e-6256-49cd-9299-f62678ffbb1e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:45 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:55:45 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:45 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.505s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:55:45 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Deleted volume successfully. Aug 26 02:55:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d8992c38-f645-49ee-8252-35e68c070711 tempest-ServerRescueNegativeTestJSON-368308817 None] Lock "cinder-0cd66fd6-de00-4e05-9142-5f2e650f8141-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:55:55 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:55:55 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Flow 'volume_create_manager' (2dcd96e2-7567-424c-9ab4-aea64e97dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272faf18-096a-4ae1-b32f-12c9d0957d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272faf18-096a-4ae1-b32f-12c9d0957d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1448246330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85533d06-300e-498c-91ab-62b689432caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf162350c7b4426b9c2418d7e29c57c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:55:58Z,use_quota=True,user_id='24a8ee88df8f4346a505b448a11dfd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ad2d13-2a38-46dd-bbb7-8859536786a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ad2d13-2a38-46dd-bbb7-8859536786a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9b4f3e-373b-44ca-b6de-4f9014725d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9b4f3e-373b-44ca-b6de-4f9014725d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85533d06-300e-498c-91ab-62b689432caf', 'volume_name': 'volume-85533d06-300e-498c-91ab-62b689432caf', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6555ee9f-7f63-4123-9786-0862b22e1a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6555ee9f-7f63-4123-9786-0862b22e1a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2403ca19-49bb-44d8-8134-f5e14d19eaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:55:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Volume 85533d06-300e-498c-91ab-62b689432caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85533d06-300e-498c-91ab-62b689432caf', 'volume_size': 1} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1448246330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85533d06-300e-498c-91ab-62b689432caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf162350c7b4426b9c2418d7e29c57c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:55:58Z,use_quota=True,user_id='24a8ee88df8f4346a505b448a11dfd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Creating volume 85533d06-300e-498c-91ab-62b689432caf {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:55:58 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:55:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:58 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf 1073741824 Aug 26 02:55:58 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:00 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf 1073741824" returned: 0 in 1.217s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:00 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf Aug 26 02:56:00 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:00 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf" returned: 0 in 0.371s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2403ca19-49bb-44d8-8134-f5e14d19eaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85533d06-300e-498c-91ab-62b689432caf', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b54507-ec2d-4602-8974-e2043830ab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:56:00 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Volume volume-85533d06-300e-498c-91ab-62b689432caf (85533d06-300e-498c-91ab-62b689432caf): created successfully Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b54507-ec2d-4602-8974-e2043830ab0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:56:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Flow 'volume_create_manager' (2dcd96e2-7567-424c-9ab4-aea64e97dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:56:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-602d7f52-170a-4c24-8e91-b5b53c62d676 tempest-DeleteServersTestJSON-1539085217 None] Created volume successfully. Aug 26 02:56:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:56:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:56:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:56:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:02 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:56:02 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:02 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.753s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:56:08 devstack cinder-volume[93797]: WARNING py.warnings [req-05abb112-5531-4c07-8eb4-821728f50211 req-899d8f4f-2ba6-4295-a520-3ab1c894801a tempest-DeleteServersTestJSON-1539085217 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 26 02:56:08 devstack cinder-volume[93797]: .first() Aug 26 02:56:08 devstack cinder-volume[93797]: Aug 26 02:56:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-05abb112-5531-4c07-8eb4-821728f50211 req-899d8f4f-2ba6-4295-a520-3ab1c894801a tempest-DeleteServersTestJSON-1539085217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-05abb112-5531-4c07-8eb4-821728f50211 req-899d8f4f-2ba6-4295-a520-3ab1c894801a tempest-DeleteServersTestJSON-1539085217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-05abb112-5531-4c07-8eb4-821728f50211 req-899d8f4f-2ba6-4295-a520-3ab1c894801a tempest-DeleteServersTestJSON-1539085217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-05abb112-5531-4c07-8eb4-821728f50211 req-899d8f4f-2ba6-4295-a520-3ab1c894801a tempest-DeleteServersTestJSON-1539085217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-85533d06-300e-498c-91ab-62b689432caf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a091e378-8d4b-4eec-8c0b-77889ef0e27f', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:56:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-05abb112-5531-4c07-8eb4-821728f50211 req-899d8f4f-2ba6-4295-a520-3ab1c894801a tempest-DeleteServersTestJSON-1539085217 None] attachment_update completed successfully. Aug 26 02:56:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-199cd79a-576f-4023-9355-30b25f86d2aa req-21f5d466-6b7e-4b8c-8ec9-1f370e65d27b tempest-DeleteServersTestJSON-1539085217 None] Terminate volume connection completed successfully. Aug 26 02:56:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-199cd79a-576f-4023-9355-30b25f86d2aa req-21f5d466-6b7e-4b8c-8ec9-1f370e65d27b tempest-DeleteServersTestJSON-1539085217 None] Deleting attachment a091e378-8d4b-4eec-8c0b-77889ef0e27f. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:56:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Acquiring lock "cinder-85533d06-300e-498c-91ab-62b689432caf-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:56:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Lock "cinder-85533d06-300e-498c-91ab-62b689432caf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:56:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Acquiring lock "cinder-quobyte-85533d06-300e-498c-91ab-62b689432caf" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:56:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Lock "cinder-quobyte-85533d06-300e-498c-91ab-62b689432caf" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:56:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f40752-e8d1-41f6-a5ee-93237b134993]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:56:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:16 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf Aug 26 02:56:16 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:16 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf" returned: 0 in 0.419s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:16 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf Aug 26 02:56:16 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:16 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-85533d06-300e-498c-91ab-62b689432caf" returned: 0 in 0.417s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Lock "cinder-quobyte-85533d06-300e-498c-91ab-62b689432caf" released by "delete_volume" :: held 0.894s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:56:16 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Created reservations ['eca6b2a2-b209-4f66-a7a6-aaf5ba6d6e9d', 'ad0bad9f-1b2e-4cee-9597-f75f8148b56c', '544a43f9-5c69-4731-bffb-a9fe102443f1', '399ef7f3-1030-4ffe-a72c-f09eb13703a2'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:17 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:56:17 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:17 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.393s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:56:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Deleted volume successfully. Aug 26 02:56:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fc4a7d8-e6d2-4543-ae65-daa939014001 tempest-DeleteServersTestJSON-1539085217 None] Lock "cinder-85533d06-300e-498c-91ab-62b689432caf-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:56:27 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=13,cinder:UPDATE=17,cinder:INSERT=5 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:56:27 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=16,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:56:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-c47826f9-ebdc-47a5-9336-92e7711d194c req-2b4bf7a4-da73-49e7-80af-68f80b47d2b6 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-c47826f9-ebdc-47a5-9336-92e7711d194c req-2b4bf7a4-da73-49e7-80af-68f80b47d2b6 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-c47826f9-ebdc-47a5-9336-92e7711d194c req-2b4bf7a4-da73-49e7-80af-68f80b47d2b6 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-c47826f9-ebdc-47a5-9336-92e7711d194c req-2b4bf7a4-da73-49e7-80af-68f80b47d2b6 tempest-ServerActionsTestOtherA-958777878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-f5237273-7ada-465d-9a39-dc48209db5b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab9bbade-b3a5-4433-b112-64d1f77a51f7', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:56:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-c47826f9-ebdc-47a5-9336-92e7711d194c req-2b4bf7a4-da73-49e7-80af-68f80b47d2b6 tempest-ServerActionsTestOtherA-958777878 None] attachment_update completed successfully. Aug 26 02:56:39 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-acf52338-c704-45a3-a80d-861e6bbbf1bc req-02832de7-4e32-4ff0-a417-0889475f686e tempest-ServerActionsTestOtherA-958777878 None] Terminate volume connection completed successfully. Aug 26 02:56:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-acf52338-c704-45a3-a80d-861e6bbbf1bc req-02832de7-4e32-4ff0-a417-0889475f686e tempest-ServerActionsTestOtherA-958777878 None] Deleting attachment ab9bbade-b3a5-4433-b112-64d1f77a51f7. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:56:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-acf52338-c704-45a3-a80d-861e6bbbf1bc req-93e3bad1-0f43-4846-ade5-8669825c1dc2 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-acf52338-c704-45a3-a80d-861e6bbbf1bc req-93e3bad1-0f43-4846-ade5-8669825c1dc2 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-acf52338-c704-45a3-a80d-861e6bbbf1bc req-93e3bad1-0f43-4846-ade5-8669825c1dc2 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-acf52338-c704-45a3-a80d-861e6bbbf1bc req-93e3bad1-0f43-4846-ade5-8669825c1dc2 tempest-ServerActionsTestOtherA-958777878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-f5237273-7ada-465d-9a39-dc48209db5b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ee11660-ebaf-49f2-a26c-207226d8bfbf', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:56:40 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-acf52338-c704-45a3-a80d-861e6bbbf1bc req-93e3bad1-0f43-4846-ade5-8669825c1dc2 tempest-ServerActionsTestOtherA-958777878 None] attachment_update completed successfully. Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Flow 'volume_create_manager' (0e5015be-d940-4e58-add1-66b6206e92d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9aa656-570b-4bd2-97fb-10cc32629655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9aa656-570b-4bd2-97fb-10cc32629655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1415676476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8f228c-ebbe-49c5-a97b-3eff7b2d7405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce226d5875834db486d5dfe91f80cfe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:56:47Z,use_quota=True,user_id='05c78eca4ac14d04ae3d4640df2f5009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8684c72-57b0-4e63-85a6-a94d959cb805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8684c72-57b0-4e63-85a6-a94d959cb805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db955f6c-8d90-419d-a883-081493ea0daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db955f6c-8d90-419d-a883-081493ea0daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8f228c-ebbe-49c5-a97b-3eff7b2d7405', 'volume_name': 'volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8d1669-435a-4b9a-93f3-19f8d97f3150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8d1669-435a-4b9a-93f3-19f8d97f3150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce63231-23c4-47d0-83cd-45b7613bf5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:56:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Volume 4b8f228c-ebbe-49c5-a97b-3eff7b2d7405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405', 'volume_size': 1} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1415676476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8f228c-ebbe-49c5-a97b-3eff7b2d7405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce226d5875834db486d5dfe91f80cfe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:56:47Z,use_quota=True,user_id='05c78eca4ac14d04ae3d4640df2f5009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Creating volume 4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:56:47 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:56:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:47 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 1073741824 Aug 26 02:56:47 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:48 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 1073741824" returned: 0 in 0.976s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:48 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 Aug 26 02:56:48 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:49 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405" returned: 0 in 0.672s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:56:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce63231-23c4-47d0-83cd-45b7613bf5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:56:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b644303-681d-4b09-b098-81234a93e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:56:49 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Volume volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 (4b8f228c-ebbe-49c5-a97b-3eff7b2d7405): created successfully Aug 26 02:56:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b644303-681d-4b09-b098-81234a93e252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:56:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Flow 'volume_create_manager' (0e5015be-d940-4e58-add1-66b6206e92d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:56:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b2959de5-76b6-49cc-9497-49bd0c2c2761 tempest-TaggedAttachmentsTest-1674465338 None] Created volume successfully. Aug 26 02:56:59 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:56:59 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:57:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:57:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:01 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:57:01 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:02 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.950s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:57:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:57:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 8 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:57:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:57:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-086163c6-5e15-4c22-bef1-87ac1c87d13f req-921ec4fc-0514-49be-bab4-4cbeca1adfcc tempest-ServerActionsTestOtherA-958777878 None] Terminate volume connection completed successfully. Aug 26 02:57:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-086163c6-5e15-4c22-bef1-87ac1c87d13f req-921ec4fc-0514-49be-bab4-4cbeca1adfcc tempest-ServerActionsTestOtherA-958777878 None] Deleting attachment 4ee11660-ebaf-49f2-a26c-207226d8bfbf. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:57:27 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:57:29 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:57:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Flow 'volume_create_manager' (e5311777-2a87-4acb-8cb6-edc5b3bf7f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0765b2-cd86-466d-b99e-f9d8ec90b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0765b2-cd86-466d-b99e-f9d8ec90b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1678231167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1aa283-8b52-4f8a-800b-59f890627e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbd996413ab40e6b1fe27edfed67e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:29Z,use_quota=True,user_id='983ebdb7f0c641a2939a87f2617965ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18fc191-5932-4171-8ae8-1401fd96a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18fc191-5932-4171-8ae8-1401fd96a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8437ed7f-fb84-41cc-89b1-a2e272504e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:29 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8437ed7f-fb84-41cc-89b1-a2e272504e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a1aa283-8b52-4f8a-800b-59f890627e36', 'volume_name': 'volume-0a1aa283-8b52-4f8a-800b-59f890627e36', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c915c7e-5230-4f50-8c0d-48114d9341dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c915c7e-5230-4f50-8c0d-48114d9341dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bb4b79-87e5-40e8-a5bd-63092dc6d3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Volume 0a1aa283-8b52-4f8a-800b-59f890627e36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a1aa283-8b52-4f8a-800b-59f890627e36', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Trying to clone 0a1aa283-8b52-4f8a-800b-59f890627e36 from image 9b965289-a39a-4dbd-8350-71f9403900aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 02:57:30 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Image download 20.69 MB at 20.69 MB/s Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a30affb-35e5-41fb-ad3f-9a4534b6985a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Flow 'volume_create_manager' (f5533752-3d3d-4027-933d-3d5be5ade7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea6009f-9fe1-42b6-a78a-3e3999fe83f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea6009f-9fe1-42b6-a78a-3e3999fe83f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1863366432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e2045-6c3c-44d8-9cb5-8352ee7292e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb63f577f6c24fb8a96d8fc98063ae57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:31Z,use_quota=True,user_id='8d74d4e933bf48799266a97ac02c6f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:30 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD Aug 26 02:57:30 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cad812-352e-4ade-8a9c-467866e74b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cad812-352e-4ade-8a9c-467866e74b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4fb286-82dd-4f88-bbff-7895a35ddb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4fb286-82dd-4f88-bbff-7895a35ddb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98e2045-6c3c-44d8-9cb5-8352ee7292e0', 'volume_name': 'volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301a5ca2-19d5-45cf-bde0-e4fcdcdc6f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301a5ca2-19d5-45cf-bde0-e4fcdcdc6f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75a9d68-ca34-4e50-badb-f0691475b47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Volume b98e2045-6c3c-44d8-9cb5-8352ee7292e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0', 'volume_size': 1} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1863366432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e2045-6c3c-44d8-9cb5-8352ee7292e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb63f577f6c24fb8a96d8fc98063ae57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:31Z,use_quota=True,user_id='8d74d4e933bf48799266a97ac02c6f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Creating volume b98e2045-6c3c-44d8-9cb5-8352ee7292e0 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:57:30 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:57:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:30 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 1073741824 Aug 26 02:57:30 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:31 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa is fetched for user 983ebdb7f0c641a2939a87f2617965ae. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca79e58-c52a-47f5-bb9d-2b8ea665dace]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:31 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD Aug 26 02:57:31 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:31 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 1073741824" returned: 0 in 0.528s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:31 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 Aug 26 02:57:31 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:31 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:31 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0" returned: 0 in 0.274s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1678231167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1aa283-8b52-4f8a-800b-59f890627e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbd996413ab40e6b1fe27edfed67e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:29Z,use_quota=True,user_id='983ebdb7f0c641a2939a87f2617965ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Creating volume 0a1aa283-8b52-4f8a-800b-59f890627e36 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:57:31 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:31 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 1073741824 Aug 26 02:57:31 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75a9d68-ca34-4e50-badb-f0691475b47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8d64d9-a3f0-49c5-ac74-6f2ac02840bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Volume volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 (b98e2045-6c3c-44d8-9cb5-8352ee7292e0): created successfully Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8d64d9-a3f0-49c5-ac74-6f2ac02840bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Flow 'volume_create_manager' (f5533752-3d3d-4027-933d-3d5be5ade7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-19ae62b9-5fa3-4f3d-a564-88b9322d9c7a tempest-ServersNegativeTestJSON-1054064120 None] Created volume successfully. Aug 26 02:57:32 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 1073741824" returned: 0 in 0.440s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:32 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 Aug 26 02:57:32 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:32 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36" returned: 0 in 0.284s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:57:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:32 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Attempting download of 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume 0a1aa283-8b52-4f8a-800b-59f890627e36. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 02:57:32 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0d295e-f219-4923-ba38-aabe9b34d42f]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:57:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_sxnepj9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:32 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_sxnepj9a Aug 26 02:57:32 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:33 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_sxnepj9a" returned: 0 in 0.448s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_sxnepj9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:33 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_sxnepj9a Aug 26 02:57:33 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:33 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_sxnepj9a" returned: 1 in 0.386s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_sxnepj9a' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffe219b-f289-41fa-877b-03249716f504]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:33 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD Aug 26 02:57:33 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:33 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] 9b965289-a39a-4dbd-8350-71f9403900aa was qcow2, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 02:57:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:33 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 Aug 26 02:57:33 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Flow 'volume_create_manager' (a431e034-df09-4658-9002-52654223cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acdc36f-5252-4955-bde0-651b1204c641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acdc36f-5252-4955-bde0-651b1204c641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-198023871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e782289b-b1b3-48bf-b0e2-a881421b271f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb63f577f6c24fb8a96d8fc98063ae57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:34Z,use_quota=True,user_id='8d74d4e933bf48799266a97ac02c6f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ee0f44-b915-49d1-8a60-5bfbec0d243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ee0f44-b915-49d1-8a60-5bfbec0d243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7421b95c-5841-4bef-a465-792af64253ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7421b95c-5841-4bef-a465-792af64253ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e782289b-b1b3-48bf-b0e2-a881421b271f', 'volume_name': 'volume-e782289b-b1b3-48bf-b0e2-a881421b271f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f0b20e-57c7-488d-86ba-619fc45f6c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f0b20e-57c7-488d-86ba-619fc45f6c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f124714-321b-49a1-a442-c93d8318512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Volume e782289b-b1b3-48bf-b0e2-a881421b271f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e782289b-b1b3-48bf-b0e2-a881421b271f', 'volume_size': 1} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-198023871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e782289b-b1b3-48bf-b0e2-a881421b271f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb63f577f6c24fb8a96d8fc98063ae57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:34Z,use_quota=True,user_id='8d74d4e933bf48799266a97ac02c6f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Creating volume e782289b-b1b3-48bf-b0e2-a881421b271f {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:57:34 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:34 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f 1073741824 Aug 26 02:57:34 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:34 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f 1073741824" returned: 0 in 0.579s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:35 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f Aug 26 02:57:35 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:35 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f" returned: 0 in 0.268s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f124714-321b-49a1-a442-c93d8318512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e782289b-b1b3-48bf-b0e2-a881421b271f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef2e38d-1633-4155-8cc1-59551c67d4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:35 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Volume volume-e782289b-b1b3-48bf-b0e2-a881421b271f (e782289b-b1b3-48bf-b0e2-a881421b271f): created successfully Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef2e38d-1633-4155-8cc1-59551c67d4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Flow 'volume_create_manager' (a431e034-df09-4658-9002-52654223cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:35 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5bfe8b74-7fd7-4ff3-b9de-292c6921c652 tempest-ServersNegativeTestJSON-1054064120 None] Created volume successfully. Aug 26 02:57:35 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36" returned: 0 in 1.982s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_246ojbrndevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 02:57:35 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Converted 112.00 MB image at 56.47 MB/s Aug 26 02:57:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:35 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 1G Aug 26 02:57:35 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:36 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 1G" returned: 0 in 0.336s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Downloaded image 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume 0a1aa283-8b52-4f8a-800b-59f890627e36 successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa for user 983ebdb7f0c641a2939a87f2617965ae is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Marking volume 0a1aa283-8b52-4f8a-800b-59f890627e36 as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Copying metadata from image 9b965289-a39a-4dbd-8350-71f9403900aa to 0a1aa283-8b52-4f8a-800b-59f890627e36. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Creating volume glance metadata for volume 0a1aa283-8b52-4f8a-800b-59f890627e36 backed by image 9b965289-a39a-4dbd-8350-71f9403900aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bb4b79-87e5-40e8-a5bd-63092dc6d3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1aa283-8b52-4f8a-800b-59f890627e36', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d505fc-9297-41aa-9ad3-8407f71b7666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:36 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Volume volume-0a1aa283-8b52-4f8a-800b-59f890627e36 (0a1aa283-8b52-4f8a-800b-59f890627e36): created successfully Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d505fc-9297-41aa-9ad3-8407f71b7666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Flow 'volume_create_manager' (e5311777-2a87-4acb-8cb6-edc5b3bf7f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d9ade22a-7de8-4d49-83e6-b670d31a156d tempest-ServerActionsTestOtherA-958777878 None] Created volume successfully. Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "cinder-e782289b-b1b3-48bf-b0e2-a881421b271f-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Lock "cinder-e782289b-b1b3-48bf-b0e2-a881421b271f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "cinder-quobyte-e782289b-b1b3-48bf-b0e2-a881421b271f" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Lock "cinder-quobyte-e782289b-b1b3-48bf-b0e2-a881421b271f" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de9260c-5f6d-4e94-ae03-5d1cad5ef5a9]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:57:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:36 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f Aug 26 02:57:36 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:37 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f" returned: 0 in 0.455s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:37 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f Aug 26 02:57:37 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:37 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e782289b-b1b3-48bf-b0e2-a881421b271f" returned: 0 in 0.273s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Lock "cinder-quobyte-e782289b-b1b3-48bf-b0e2-a881421b271f" released by "delete_volume" :: held 0.772s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Created reservations ['fc88219c-0971-4084-a005-413aafd07a33', 'e367e66e-e58c-4c0d-909b-c5e808cf0605', 'aaad509d-5947-4b17-99da-0eb7691becbd', '0f607f10-4605-4ea1-b8fa-5e78ec4db522'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:37 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:57:37 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "cinder-b98e2045-6c3c-44d8-9cb5-8352ee7292e0-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Lock "cinder-b98e2045-6c3c-44d8-9cb5-8352ee7292e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "cinder-quobyte-b98e2045-6c3c-44d8-9cb5-8352ee7292e0" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Lock "cinder-quobyte-b98e2045-6c3c-44d8-9cb5-8352ee7292e0" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e135f3b-d1ae-4d0d-ab7b-daa3bdaaea55]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:57:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:38 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.328s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:57:38 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Deleted volume successfully. Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11361b8c-48d3-4f6f-8288-73d14a044643 tempest-ServersNegativeTestJSON-1054064120 None] Lock "cinder-e782289b-b1b3-48bf-b0e2-a881421b271f-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:57:38 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 Aug 26 02:57:38 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:38 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0" returned: 0 in 0.387s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:38 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0 Aug 26 02:57:38 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:38 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b98e2045-6c3c-44d8-9cb5-8352ee7292e0" returned: 0 in 0.354s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Lock "cinder-quobyte-b98e2045-6c3c-44d8-9cb5-8352ee7292e0" released by "delete_volume" :: held 0.795s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Created reservations ['09e468f2-6b4c-4f72-baf9-1957b6d06d02', '7b05daef-88b0-4b5e-bc6d-f68a9087d3bd', '49242fe3-9884-4723-9312-123aa0fc140b', '4b4521c3-e606-42f4-8b73-d96589aa6212'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:38 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:57:38 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:39 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.302s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:39 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:57:39 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Deleted volume successfully. Aug 26 02:57:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7743f03d-7d77-4acd-9c1d-c1795bb6f624 tempest-ServersNegativeTestJSON-1054064120 None] Lock "cinder-b98e2045-6c3c-44d8-9cb5-8352ee7292e0-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:57:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-b53c1c71-77cd-42d5-bc01-a39f36092808 req-202331a0-00f2-4baa-8151-6fc8b8a8b407 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-b53c1c71-77cd-42d5-bc01-a39f36092808 req-202331a0-00f2-4baa-8151-6fc8b8a8b407 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-b53c1c71-77cd-42d5-bc01-a39f36092808 req-202331a0-00f2-4baa-8151-6fc8b8a8b407 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-b53c1c71-77cd-42d5-bc01-a39f36092808 req-202331a0-00f2-4baa-8151-6fc8b8a8b407 tempest-ServerActionsTestOtherA-958777878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-0a1aa283-8b52-4f8a-800b-59f890627e36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98d2927a-2391-4c4c-b0dd-1337e2d62095', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:57:40 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-b53c1c71-77cd-42d5-bc01-a39f36092808 req-202331a0-00f2-4baa-8151-6fc8b8a8b407 tempest-ServerActionsTestOtherA-958777878 None] attachment_update completed successfully. Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Flow 'volume_create_manager' (ba99e51e-8ef4-4fde-9d7c-80a281f2c86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d274d4-d908-4134-b654-8af49152f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d274d4-d908-4134-b654-8af49152f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-281760798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d397bc45-d9ad-49b6-af96-e0cf9ad14dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d9880a3e541048c808b8704d0efda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:46Z,use_quota=True,user_id='64aea7e8c42f497d8b01e01bea3b4d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f5b0f-7c2d-459d-883d-96a5f295f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f5b0f-7c2d-459d-883d-96a5f295f366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d7a636-3984-467a-b9cd-16b91faa0aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d7a636-3984-467a-b9cd-16b91faa0aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd397bc45-d9ad-49b6-af96-e0cf9ad14dc6', 'volume_name': 'volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915cd305-9a2d-48ad-b79e-52a978e17378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915cd305-9a2d-48ad-b79e-52a978e17378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2935297-258b-4a4c-80e7-544e36bf000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:46 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Volume d397bc45-d9ad-49b6-af96-e0cf9ad14dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6', 'volume_size': 1} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-281760798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d397bc45-d9ad-49b6-af96-e0cf9ad14dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d9880a3e541048c808b8704d0efda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:46Z,use_quota=True,user_id='64aea7e8c42f497d8b01e01bea3b4d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Creating volume d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:57:46 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:57:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:46 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 1073741824 Aug 26 02:57:46 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:47 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 1073741824" returned: 0 in 0.804s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:47 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 Aug 26 02:57:47 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:47 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6" returned: 0 in 0.376s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2935297-258b-4a4c-80e7-544e36bf000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf1bebe-54a5-4556-ae28-94a84b13e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Volume volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 (d397bc45-d9ad-49b6-af96-e0cf9ad14dc6): created successfully Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf1bebe-54a5-4556-ae28-94a84b13e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Flow 'volume_create_manager' (ba99e51e-8ef4-4fde-9d7c-80a281f2c86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:47 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-30cdc5a4-7ea4-470c-b36f-2d0714e3b697 tempest-AttachVolumeTestJSON-496442869 None] Created volume successfully. Aug 26 02:57:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-cc397cc6-6279-4a3e-a069-49be39203af4 req-b6c3670b-3faf-4b07-bb29-e9aeab834041 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-cc397cc6-6279-4a3e-a069-49be39203af4 req-b6c3670b-3faf-4b07-bb29-e9aeab834041 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-cc397cc6-6279-4a3e-a069-49be39203af4 req-b6c3670b-3faf-4b07-bb29-e9aeab834041 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-cc397cc6-6279-4a3e-a069-49be39203af4 req-b6c3670b-3faf-4b07-bb29-e9aeab834041 tempest-AttachVolumeTestJSON-496442869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a34fe0a-a782-4a39-92d7-4b66ba9b18f2', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:57:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-cc397cc6-6279-4a3e-a069-49be39203af4 req-b6c3670b-3faf-4b07-bb29-e9aeab834041 tempest-AttachVolumeTestJSON-496442869 None] attachment_update completed successfully. Aug 26 02:57:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f7f442eb-db4c-4413-82e7-31d5f933d2dd req-b2ea3d79-7645-4cc9-a43a-1c7c3548ffc4 tempest-TaggedAttachmentsTest-1674465338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f7f442eb-db4c-4413-82e7-31d5f933d2dd req-b2ea3d79-7645-4cc9-a43a-1c7c3548ffc4 tempest-TaggedAttachmentsTest-1674465338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f7f442eb-db4c-4413-82e7-31d5f933d2dd req-b2ea3d79-7645-4cc9-a43a-1c7c3548ffc4 tempest-TaggedAttachmentsTest-1674465338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-f7f442eb-db4c-4413-82e7-31d5f933d2dd req-b2ea3d79-7645-4cc9-a43a-1c7c3548ffc4 tempest-TaggedAttachmentsTest-1674465338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9191e37-88da-4b9d-b078-75c96fe02892', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:57:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-f7f442eb-db4c-4413-82e7-31d5f933d2dd req-b2ea3d79-7645-4cc9-a43a-1c7c3548ffc4 tempest-TaggedAttachmentsTest-1674465338 None] attachment_update completed successfully. Aug 26 02:57:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-a0ca4223-4147-48f6-bb94-9b67f329858f req-56b49191-8114-4ae9-a7b4-1f36ff67f666 tempest-TaggedAttachmentsTest-1674465338 None] Terminate volume connection completed successfully. Aug 26 02:57:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-a0ca4223-4147-48f6-bb94-9b67f329858f req-56b49191-8114-4ae9-a7b4-1f36ff67f666 tempest-TaggedAttachmentsTest-1674465338 None] Deleting attachment d9191e37-88da-4b9d-b078-75c96fe02892. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Flow 'volume_create_manager' (e7331236-89e6-4a4c-a6ac-f01297a98fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a981aac3-ff4f-46f9-8894-f877093c8e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a981aac3-ff4f-46f9-8894-f877093c8e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-582649509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138877b8-9710-4193-83dc-41b17e27f78e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f3305f1a72b4688bb740d8a34925d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:00Z,use_quota=True,user_id='bca6edf293f44ffe878c0772d9ae486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c232ae7-8288-494d-9041-a19f272030c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c232ae7-8288-494d-9041-a19f272030c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb6cdd6-be52-4e8d-bc0a-4f07ace9c5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb6cdd6-be52-4e8d-bc0a-4f07ace9c5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138877b8-9710-4193-83dc-41b17e27f78e', 'volume_name': 'volume-138877b8-9710-4193-83dc-41b17e27f78e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd9f14c-e8d2-4182-b8b2-50726cf507ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd9f14c-e8d2-4182-b8b2-50726cf507ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8ec923-8cac-4a8d-ac2d-732a4eba6b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Volume 138877b8-9710-4193-83dc-41b17e27f78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138877b8-9710-4193-83dc-41b17e27f78e', 'volume_size': 1} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-582649509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138877b8-9710-4193-83dc-41b17e27f78e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f3305f1a72b4688bb740d8a34925d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:00Z,use_quota=True,user_id='bca6edf293f44ffe878c0772d9ae486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Creating volume 138877b8-9710-4193-83dc-41b17e27f78e {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:58:00 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:58:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:00 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e 1073741824 Aug 26 02:58:00 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e 1073741824" returned: 0 in 1.418s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:01 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:58:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:02 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:58:02 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:02 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e Aug 26 02:58:02 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:02 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.819s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:58:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:58:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:58:03 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e" returned: 0 in 0.913s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] <== create_volume: return (2614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:58:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.620s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8ec923-8cac-4a8d-ac2d-732a4eba6b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138877b8-9710-4193-83dc-41b17e27f78e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd7e4cb-3d39-4e01-b9f4-ee2829eb3ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:03 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Volume volume-138877b8-9710-4193-83dc-41b17e27f78e (138877b8-9710-4193-83dc-41b17e27f78e): created successfully Aug 26 02:58:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd7e4cb-3d39-4e01-b9f4-ee2829eb3ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Flow 'volume_create_manager' (e7331236-89e6-4a4c-a6ac-f01297a98fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-6a1b2de7-c186-46fe-9f1e-aa837329c1b3 req-396a7851-0aa7-42a9-8eca-abdc677e4afa tempest-VolumesGetTestJSON-738036553 None] Created volume successfully. Aug 26 02:58:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Acquiring lock "cinder-138877b8-9710-4193-83dc-41b17e27f78e-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Lock "cinder-138877b8-9710-4193-83dc-41b17e27f78e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Acquiring lock "cinder-quobyte-138877b8-9710-4193-83dc-41b17e27f78e" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Lock "cinder-quobyte-138877b8-9710-4193-83dc-41b17e27f78e" acquired by "delete_volume" :: waited 0.054s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:04 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb76e4c7-2bbf-4fc3-868b-a336dc14bedc]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:04 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e Aug 26 02:58:04 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:05 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e" returned: 0 in 0.741s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:05 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e Aug 26 02:58:05 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:05 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-138877b8-9710-4193-83dc-41b17e27f78e" returned: 0 in 0.494s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Lock "cinder-quobyte-138877b8-9710-4193-83dc-41b17e27f78e" released by "delete_volume" :: held 1.381s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG cinder.quota [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Created reservations ['973de9a3-18a8-4ece-8f24-c240c2efd4d2', 'f98e198f-8392-48fc-802d-fa7065042629', 'd9dd8c24-f9e8-44b3-b4b3-d08e9f458a30', '6c3bb0a5-b996-46f3-b761-aae8ac8ce0fc'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:06 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:58:06 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:06 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.467s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG cinder.manager [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Deleted volume successfully. Aug 26 02:58:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-91792bdc-a6ca-4a6b-bb32-6f65084b656a req-0a150fa1-6b13-444d-aa74-e363eb593269 tempest-VolumesGetTestJSON-738036553 None] Lock "cinder-138877b8-9710-4193-83dc-41b17e27f78e-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:07 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-031f8fa3-1fd5-4f65-b63d-69f167777542 req-030db5e3-77dd-4ece-8d67-e01d87015087 tempest-ServerActionsTestOtherA-958777878 None] Terminate volume connection completed successfully. Aug 26 02:58:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-031f8fa3-1fd5-4f65-b63d-69f167777542 req-030db5e3-77dd-4ece-8d67-e01d87015087 tempest-ServerActionsTestOtherA-958777878 None] Deleting attachment 98d2927a-2391-4c4c-b0dd-1337e2d62095. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:58:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-031f8fa3-1fd5-4f65-b63d-69f167777542 req-a8a2bb77-0ca5-47fd-a594-4b59d5777448 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-031f8fa3-1fd5-4f65-b63d-69f167777542 req-a8a2bb77-0ca5-47fd-a594-4b59d5777448 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-031f8fa3-1fd5-4f65-b63d-69f167777542 req-a8a2bb77-0ca5-47fd-a594-4b59d5777448 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-031f8fa3-1fd5-4f65-b63d-69f167777542 req-a8a2bb77-0ca5-47fd-a594-4b59d5777448 tempest-ServerActionsTestOtherA-958777878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-0a1aa283-8b52-4f8a-800b-59f890627e36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '227bd057-4747-4adf-b4d1-de0395f2200c', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:58:12 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-031f8fa3-1fd5-4f65-b63d-69f167777542 req-a8a2bb77-0ca5-47fd-a594-4b59d5777448 tempest-ServerActionsTestOtherA-958777878 None] attachment_update completed successfully. Aug 26 02:58:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Acquiring lock "cinder-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Lock "cinder-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Acquiring lock "cinder-quobyte-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Lock "cinder-quobyte-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5531bd5-99a9-46ac-a6ac-819770ac7ac4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:17 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 Aug 26 02:58:17 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:17 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405" returned: 0 in 0.930s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:17 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405 Aug 26 02:58:17 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:18 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405" returned: 0 in 0.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Lock "cinder-quobyte-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405" released by "delete_volume" :: held 1.311s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Created reservations ['ee11e8a5-f903-4ef6-97d0-97d1e11f621c', '73e795e3-a246-4d77-8da7-023dea6bebac', 'f48e7106-7dcc-4812-85aa-6fa63a107810', '1fc1345c-eae3-48d2-b09b-4352c5efe444'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:18 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:58:18 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:18 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.403s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:18 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Deleted volume successfully. Aug 26 02:58:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51dd7e6d-1dc9-4089-9c36-1b692400ef10 tempest-TaggedAttachmentsTest-1674465338 None] Lock "cinder-4b8f228c-ebbe-49c5-a97b-3eff7b2d7405-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:28 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=65,cinder:UPDATE=54,cinder:INSERT=18,cinder:DELETE=4 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:58:28 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=67,cinder:UPDATE=56,cinder:INSERT=16,cinder:DELETE=5 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:58:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e1661796-e0cf-48cf-bfab-215099925acd tempest-GroupsTest-188840161 None] Group tempest-Group1-1211013376: creating Aug 26 02:58:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e1661796-e0cf-48cf-bfab-215099925acd tempest-GroupsTest-188840161 None] Group tempest-Group1-1211013376: created successfully Aug 26 02:58:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e1661796-e0cf-48cf-bfab-215099925acd tempest-GroupsTest-188840161 None] Create group completed successfully. Aug 26 02:58:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-a3d5a82d-d877-4876-8bd0-c59e838830fc req-29b354d8-f7e1-46ed-ba33-c6cea98c0978 tempest-AttachVolumeTestJSON-496442869 None] Terminate volume connection completed successfully. Aug 26 02:58:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-a3d5a82d-d877-4876-8bd0-c59e838830fc req-29b354d8-f7e1-46ed-ba33-c6cea98c0978 tempest-AttachVolumeTestJSON-496442869 None] Deleting attachment 2a34fe0a-a782-4a39-92d7-4b66ba9b18f2. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:58:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b275da26-6a9c-4572-bc36-c012ae6a7c84 tempest-GroupsTest-188840161 None] Group tempest-Group2-2139457807: creating Aug 26 02:58:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b275da26-6a9c-4572-bc36-c012ae6a7c84 tempest-GroupsTest-188840161 None] Group tempest-Group2-2139457807: created successfully Aug 26 02:58:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b275da26-6a9c-4572-bc36-c012ae6a7c84 tempest-GroupsTest-188840161 None] Create group completed successfully. Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Flow 'volume_create_manager' (b1e356f6-8635-4a4e-b210-690eee1eb73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c52394-c156-4d8c-9b52-d0a1e0b0ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c52394-c156-4d8c-9b52-d0a1e0b0ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820352866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=059f724c-a570-4247-bb07-582df855ad41,host='devstack@QuobyteHD#QuobyteHD',id=d3133698-e8e2-4cfa-9dac-47fce7eda206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5715b0264364421a9011a9b94ef40619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:35Z,use_quota=True,user_id='94e875a0e73c434dafab2bdcc3000b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a38b60de-1bd1-4814-82b8-d1f6c6ff3437),volume_type_id=a38b60de-1bd1-4814-82b8-d1f6c6ff3437)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc070094-b801-4e0b-b14a-1ae7a593c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc070094-b801-4e0b-b14a-1ae7a593c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be983add-3458-4fef-b227-aa321390841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be983add-3458-4fef-b227-aa321390841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3133698-e8e2-4cfa-9dac-47fce7eda206', 'volume_name': 'volume-d3133698-e8e2-4cfa-9dac-47fce7eda206', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2ffafc-f252-4ae8-97e7-153ad10e8d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2ffafc-f252-4ae8-97e7-153ad10e8d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae39ff1-0282-4338-9fac-5f76efd27f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:35 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Volume d3133698-e8e2-4cfa-9dac-47fce7eda206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3133698-e8e2-4cfa-9dac-47fce7eda206', 'volume_size': 1} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=059f724c-a570-4247-bb07-582df855ad41,created_at=2026-08-26T00:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820352866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=059f724c-a570-4247-bb07-582df855ad41,host='devstack@QuobyteHD#QuobyteHD',id=d3133698-e8e2-4cfa-9dac-47fce7eda206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5715b0264364421a9011a9b94ef40619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:35Z,use_quota=True,user_id='94e875a0e73c434dafab2bdcc3000b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a38b60de-1bd1-4814-82b8-d1f6c6ff3437),volume_type_id=a38b60de-1bd1-4814-82b8-d1f6c6ff3437)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Creating volume d3133698-e8e2-4cfa-9dac-47fce7eda206 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:58:35 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:58:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:35 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 1073741824 Aug 26 02:58:35 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:36 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 1073741824" returned: 0 in 0.801s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:36 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 Aug 26 02:58:36 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:37 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206" returned: 0 in 0.381s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:58:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae39ff1-0282-4338-9fac-5f76efd27f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3133698-e8e2-4cfa-9dac-47fce7eda206', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e71dc35-4c49-4876-8d23-d9ce33d2432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:37 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Volume volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 (d3133698-e8e2-4cfa-9dac-47fce7eda206): created successfully Aug 26 02:58:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e71dc35-4c49-4876-8d23-d9ce33d2432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Flow 'volume_create_manager' (b1e356f6-8635-4a4e-b210-690eee1eb73a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:37 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-676a1947-acbd-487b-b399-9886b5612f12 tempest-GroupsTest-188840161 None] Created volume successfully. Aug 26 02:58:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Acquiring lock "cinder-quobyte-d3133698-e8e2-4cfa-9dac-47fce7eda206" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Lock "cinder-quobyte-d3133698-e8e2-4cfa-9dac-47fce7eda206" acquired by "delete_volume" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:39 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9121503d-7e86-47a6-b074-acc020837f5b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:39 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 Aug 26 02:58:39 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:40 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206" returned: 0 in 0.645s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:40 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206 Aug 26 02:58:40 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:40 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d3133698-e8e2-4cfa-9dac-47fce7eda206" returned: 0 in 0.279s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Lock "cinder-quobyte-d3133698-e8e2-4cfa-9dac-47fce7eda206" released by "delete_volume" :: held 0.996s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Created reservations ['5ea9629e-be52-47fa-8768-b5b9a9c1fabc'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:40 devstack cinder-volume[93797]: WARNING cinder.quota [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-627303979 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-627303979, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:58:40 devstack cinder-volume[93797]: WARNING cinder.quota [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-627303979 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-627303979, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Created reservations ['b36ecbfa-7df3-4d29-a80d-397df0977c4a', 'abc67751-5dbd-4d65-82ec-50fccd4f03a5', '649ebd72-b5f5-4351-8b6d-d6320d248031', '1bcba547-0219-4493-ac68-9ec2eb57d14f'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:40 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:58:40 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:41 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.404s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:41 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b9a867e2-8d81-4572-a98b-7455da459b7d tempest-GroupsTest-188840161 None] Delete group completed successfully. Aug 26 02:58:41 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Created reservations ['1ff7bd86-dbb1-4bf1-8164-0a3a84eb240a'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:42 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:58:42 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:42 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.301s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:42 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d4b04745-d8a1-4f22-b7ec-02588dc32ea7 tempest-GroupsTest-188840161 None] Delete group completed successfully. Aug 26 02:58:43 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-60a66123-bfb7-423b-932f-ba855febd990 tempest-GroupsTest-188840161 None] Group tempest-GroupsTest-Group-2035938268: creating Aug 26 02:58:44 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-60a66123-bfb7-423b-932f-ba855febd990 tempest-GroupsTest-188840161 None] Group tempest-GroupsTest-Group-2035938268: created successfully Aug 26 02:58:44 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-60a66123-bfb7-423b-932f-ba855febd990 tempest-GroupsTest-188840161 None] Create group completed successfully. Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Flow 'volume_create_manager' (b4bafe1e-96e4-4c87-a704-580a7f23b759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85b6b49-d49a-46b5-a72b-23938c52951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85b6b49-d49a-46b5-a72b-23938c52951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102042356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6651d76b-301c-4ccc-b5b5-9c000a677129,host='devstack@QuobyteHD#QuobyteHD',id=05a220af-2c84-40bc-9bfd-0e3b56060b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5715b0264364421a9011a9b94ef40619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:46Z,use_quota=True,user_id='94e875a0e73c434dafab2bdcc3000b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b5618f3-aba8-4c53-8453-09ac31dd5fd2),volume_type_id=3b5618f3-aba8-4c53-8453-09ac31dd5fd2)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e34d77a-feab-4dd5-a8d7-5afe12078a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e34d77a-feab-4dd5-a8d7-5afe12078a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3207013-a48f-4aaf-9d67-96b60acf14cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3207013-a48f-4aaf-9d67-96b60acf14cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a220af-2c84-40bc-9bfd-0e3b56060b2a', 'volume_name': 'volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9326c3e8-ab18-4e49-8f4f-ccb8706b31b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9326c3e8-ab18-4e49-8f4f-ccb8706b31b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8794feac-67b6-40bd-9faf-340e7cdcd9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:46 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Volume 05a220af-2c84-40bc-9bfd-0e3b56060b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a', 'volume_size': 1} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6651d76b-301c-4ccc-b5b5-9c000a677129,created_at=2026-08-26T00:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102042356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6651d76b-301c-4ccc-b5b5-9c000a677129,host='devstack@QuobyteHD#QuobyteHD',id=05a220af-2c84-40bc-9bfd-0e3b56060b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5715b0264364421a9011a9b94ef40619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:46Z,use_quota=True,user_id='94e875a0e73c434dafab2bdcc3000b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b5618f3-aba8-4c53-8453-09ac31dd5fd2),volume_type_id=3b5618f3-aba8-4c53-8453-09ac31dd5fd2)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Creating volume 05a220af-2c84-40bc-9bfd-0e3b56060b2a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:58:46 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:46 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a 1073741824 Aug 26 02:58:46 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:46 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a 1073741824" returned: 0 in 0.618s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:46 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a Aug 26 02:58:46 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:47 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a" returned: 0 in 0.303s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:58:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8794feac-67b6-40bd-9faf-340e7cdcd9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b2770b-8411-495e-942d-7c72ecd436b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Volume volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a (05a220af-2c84-40bc-9bfd-0e3b56060b2a): created successfully Aug 26 02:58:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b2770b-8411-495e-942d-7c72ecd436b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Flow 'volume_create_manager' (b4bafe1e-96e4-4c87-a704-580a7f23b759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:47 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7a6ed530-9fd2-46c7-94de-0d9afcb95803 tempest-GroupsTest-188840161 None] Created volume successfully. Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Flow 'volume_create_manager' (e4af2104-136c-4d49-88a3-1543d057a1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ecc63a-fb2b-4382-9ac1-c5d374451190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ecc63a-fb2b-4382-9ac1-c5d374451190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498472370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6651d76b-301c-4ccc-b5b5-9c000a677129,host='devstack@QuobyteHD#QuobyteHD',id=e112c693-d2b7-49d5-90fa-d2b97e49b725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5715b0264364421a9011a9b94ef40619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:50Z,use_quota=True,user_id='94e875a0e73c434dafab2bdcc3000b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b5618f3-aba8-4c53-8453-09ac31dd5fd2),volume_type_id=3b5618f3-aba8-4c53-8453-09ac31dd5fd2)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a5e6b1-5cac-4b6b-b213-1e79a8cbe315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a5e6b1-5cac-4b6b-b213-1e79a8cbe315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f8d27d-61af-4e01-a413-91cfbde9fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f8d27d-61af-4e01-a413-91cfbde9fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e112c693-d2b7-49d5-90fa-d2b97e49b725', 'volume_name': 'volume-e112c693-d2b7-49d5-90fa-d2b97e49b725', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3f756b-e767-45f1-828e-c1e0fdd2a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3f756b-e767-45f1-828e-c1e0fdd2a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22cf4e8-6c8b-4264-a270-f70e9c8c0052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:50 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Volume e112c693-d2b7-49d5-90fa-d2b97e49b725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e112c693-d2b7-49d5-90fa-d2b97e49b725', 'volume_size': 1} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6651d76b-301c-4ccc-b5b5-9c000a677129,created_at=2026-08-26T00:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498472370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6651d76b-301c-4ccc-b5b5-9c000a677129,host='devstack@QuobyteHD#QuobyteHD',id=e112c693-d2b7-49d5-90fa-d2b97e49b725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5715b0264364421a9011a9b94ef40619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:50Z,use_quota=True,user_id='94e875a0e73c434dafab2bdcc3000b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b5618f3-aba8-4c53-8453-09ac31dd5fd2),volume_type_id=3b5618f3-aba8-4c53-8453-09ac31dd5fd2)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Creating volume e112c693-d2b7-49d5-90fa-d2b97e49b725 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:58:50 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:58:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:50 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 1073741824 Aug 26 02:58:50 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:51 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 1073741824" returned: 0 in 0.879s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:51 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 Aug 26 02:58:51 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:51 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725" returned: 0 in 0.503s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22cf4e8-6c8b-4264-a270-f70e9c8c0052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e112c693-d2b7-49d5-90fa-d2b97e49b725', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6b3797-5be8-48d1-aca5-0dc1d4b541a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:51 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Volume volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 (e112c693-d2b7-49d5-90fa-d2b97e49b725): created successfully Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6b3797-5be8-48d1-aca5-0dc1d4b541a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Flow 'volume_create_manager' (e4af2104-136c-4d49-88a3-1543d057a1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:51 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-dd4677e9-fc2a-43e2-86d3-9b8d9d64f8e9 tempest-GroupsTest-188840161 None] Created volume successfully. Aug 26 02:58:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1f7b2fc4-fbc1-419a-9ab0-0a300b9fe367 tempest-ServerActionsTestOtherA-958777878 None] Terminate volume connection completed successfully. Aug 26 02:58:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1f7b2fc4-fbc1-419a-9ab0-0a300b9fe367 tempest-ServerActionsTestOtherA-958777878 None] Deleting attachment 227bd057-4747-4adf-b4d1-de0395f2200c. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:58:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "cinder-0a1aa283-8b52-4f8a-800b-59f890627e36-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Lock "cinder-0a1aa283-8b52-4f8a-800b-59f890627e36-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "cinder-quobyte-0a1aa283-8b52-4f8a-800b-59f890627e36" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Lock "cinder-quobyte-0a1aa283-8b52-4f8a-800b-59f890627e36" acquired by "delete_volume" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d3ddbc-e8b3-4f36-a054-4211858c82e8]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:53 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 Aug 26 02:58:53 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-54a91dfd-c943-4a5c-8ab9-ff3a32ee5c8d tempest-GroupsTest-188840161 None] Update group completed successfully. Aug 26 02:58:53 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36" returned: 0 in 0.685s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:53 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36 Aug 26 02:58:53 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "cinder-f5237273-7ada-465d-9a39-dc48209db5b1-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Lock "cinder-f5237273-7ada-465d-9a39-dc48209db5b1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "cinder-quobyte-f5237273-7ada-465d-9a39-dc48209db5b1" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Lock "cinder-quobyte-f5237273-7ada-465d-9a39-dc48209db5b1" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4526a-78b5-4810-87cf-78ab4ac4b603]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:53 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 Aug 26 02:58:53 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:53 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0a1aa283-8b52-4f8a-800b-59f890627e36" returned: 0 in 0.369s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Lock "cinder-quobyte-0a1aa283-8b52-4f8a-800b-59f890627e36" released by "delete_volume" :: held 1.158s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.quota [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Created reservations ['e07a7337-99bf-4c34-ad57-8cc31432c57d', 'e4bbed19-1cac-4e52-a9d5-db4bf3bda2fa', '5428387b-2965-4619-953c-4d1f95513cab', '6f91be2c-f6c0-4ce0-a5d3-b7754ada7db7'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:54 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:58:54 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:54 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1" returned: 0 in 0.433s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:54 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1 Aug 26 02:58:54 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:54 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.323s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.manager [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Deleted volume successfully. Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-765d3e36-88ed-43b3-9582-0ab91c3d80d6 req-1362b766-c6de-41fa-b46f-7ec9764abf10 tempest-ServerActionsTestOtherA-958777878 None] Lock "cinder-0a1aa283-8b52-4f8a-800b-59f890627e36-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:54 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5237273-7ada-465d-9a39-dc48209db5b1" returned: 0 in 0.367s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Lock "cinder-quobyte-f5237273-7ada-465d-9a39-dc48209db5b1" released by "delete_volume" :: held 0.856s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Created reservations ['f3e915ca-d1ed-4bed-9eac-33ca10033c19', 'b9878b00-964f-4ee5-a365-c80be695d5df', 'e0b5be14-339b-43c9-a435-5690021b82c7', '4a0c3166-2909-4cfa-8682-4918e7dcf638'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:54 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:58:54 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a22e0921-9b61-48a3-b78a-b52efde2acf2 tempest-GroupsTest-188840161 None] Update group completed successfully. Aug 26 02:58:55 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.365s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:55 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:55 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Deleted volume successfully. Aug 26 02:58:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4b85a5b-45d4-49a8-a7ac-be170ccafc79 tempest-ServerActionsTestOtherA-958777878 None] Lock "cinder-f5237273-7ada-465d-9a39-dc48209db5b1-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Acquiring lock "cinder-quobyte-05a220af-2c84-40bc-9bfd-0e3b56060b2a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Lock "cinder-quobyte-05a220af-2c84-40bc-9bfd-0e3b56060b2a" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:56 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2812fb25-0bef-4875-8ad4-26cde45f2abf]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:56 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a Aug 26 02:58:56 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:57 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a" returned: 0 in 0.497s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:57 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a Aug 26 02:58:57 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:57 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-05a220af-2c84-40bc-9bfd-0e3b56060b2a" returned: 0 in 0.409s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Lock "cinder-quobyte-05a220af-2c84-40bc-9bfd-0e3b56060b2a" released by "delete_volume" :: held 0.950s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Acquiring lock "cinder-quobyte-e112c693-d2b7-49d5-90fa-d2b97e49b725" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Lock "cinder-quobyte-e112c693-d2b7-49d5-90fa-d2b97e49b725" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:57 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f0e6a5-6903-4303-9df9-da680c80345c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:57 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 Aug 26 02:58:57 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:58 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725" returned: 0 in 0.599s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:58 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725 Aug 26 02:58:58 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:58 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e112c693-d2b7-49d5-90fa-d2b97e49b725" returned: 0 in 0.391s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Lock "cinder-quobyte-e112c693-d2b7-49d5-90fa-d2b97e49b725" released by "delete_volume" :: held 1.068s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:58 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Created reservations ['9f17fd2e-b504-4597-9c83-45008c9833ff'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:58 devstack cinder-volume[93797]: WARNING cinder.quota [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-46903809 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-46903809, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:58:58 devstack cinder-volume[93797]: WARNING cinder.quota [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-46903809 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-46903809, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:58:58 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Created reservations ['3b597af1-5f54-4ad6-860a-a6a39b3d4712', '0a2c9ebd-ad7f-473e-857a-55050f042ca0', 'e939f566-4946-4481-91a9-e9348a94daf3', 'b56ba4a0-ff41-4717-a14e-c71b508f5528'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Created reservations ['a116f650-e430-4f24-be77-0e150b2b0733', 'bd6ae566-cd9c-409a-9f9f-84389ef648d0', '2978f882-2903-4dd6-84ad-95d2dd3d5bb1', 'a675154c-48f8-452a-96ac-0f4dab31f4db'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:59 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:58:59 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:59 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.342s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:59 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a64c94ec-cce5-419b-bf36-561b2d99de11 tempest-GroupsTest-188840161 None] Delete group completed successfully. Aug 26 02:59:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:59:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:02 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:59:02 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:02 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.514s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:59:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:59:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:59:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:59:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=58,cinder:SELECT=47,cinder:INSERT=17,cinder:DELETE=3 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:59:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=59,cinder:UPDATE=65,cinder:INSERT=9,cinder:DELETE=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Flow 'volume_create_manager' (522420cc-6d29-493e-94e2-1627d8d1f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ff2e78-e9e2-4a81-ac82-f2b608d0a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ff2e78-e9e2-4a81-ac82-f2b608d0a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-297256078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043e5226-2a50-452a-825c-7ab980fd5654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebca9581c8448ab18e7d59262e7d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:14Z,use_quota=True,user_id='09b0d1473fda48a9a026b1e2a803bf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6941c74-8a58-4b87-b401-06316b209e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6941c74-8a58-4b87-b401-06316b209e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c9a07b-4892-49b6-8a23-dd869b6af08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c9a07b-4892-49b6-8a23-dd869b6af08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043e5226-2a50-452a-825c-7ab980fd5654', 'volume_name': 'volume-043e5226-2a50-452a-825c-7ab980fd5654', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e74ecf6-8933-4ced-81a1-dbca8a2fa268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e74ecf6-8933-4ced-81a1-dbca8a2fa268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df4cb74-ba48-4fdf-bd79-878fd22f01cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:13 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Volume 043e5226-2a50-452a-825c-7ab980fd5654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043e5226-2a50-452a-825c-7ab980fd5654', 'volume_size': 1} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-297256078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043e5226-2a50-452a-825c-7ab980fd5654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebca9581c8448ab18e7d59262e7d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:14Z,use_quota=True,user_id='09b0d1473fda48a9a026b1e2a803bf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Creating volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:59:13 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:59:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:13 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 1073741824 Aug 26 02:59:13 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:14 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 1073741824" returned: 0 in 0.776s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:14 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 Aug 26 02:59:14 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:15 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654" returned: 0 in 0.483s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:59:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df4cb74-ba48-4fdf-bd79-878fd22f01cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043e5226-2a50-452a-825c-7ab980fd5654', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cc1b03-4c0f-4990-a31d-b9344b372216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Volume volume-043e5226-2a50-452a-825c-7ab980fd5654 (043e5226-2a50-452a-825c-7ab980fd5654): created successfully Aug 26 02:59:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cc1b03-4c0f-4990-a31d-b9344b372216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Flow 'volume_create_manager' (522420cc-6d29-493e-94e2-1627d8d1f648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1d21404b-15bd-433b-b6c1-057951b86ad7 tempest-SnapshotsActionsTest-1376972385 None] Created volume successfully. Aug 26 02:59:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Creating offline snapshot 8423ec76-3811-4923-8b9b-3baa411e5358 of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe8377-bd51-464e-b629-13bdc82686b2]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:16 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 Aug 26 02:59:16 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:17 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654" returned: 0 in 0.757s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:17 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 1G Aug 26 02:59:17 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:17 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 1G" returned: 0 in 0.625s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:17 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:17 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:18 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.693s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:18 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 is being set with open permissions: ugo+rw Aug 26 02:59:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:18 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:18 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:19 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.632s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:19 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.info Aug 26 02:59:19 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:19 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.info" returned: 0 in 0.499s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:19 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.info is being set with open permissions: ugo+rw Aug 26 02:59:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:19 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.info Aug 26 02:59:19 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:20 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.info" returned: 0 in 0.503s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.874s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f8f73d42-dd67-4b2a-92fe-39951dab89e3 tempest-SnapshotsActionsTest-1376972385 None] Create snapshot completed successfully Aug 26 02:59:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Creating offline snapshot c07fdc5d-b779-40a0-a9a1-98c7e9abe48d of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:22 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[34328050-cc62-4a2b-aec9-6eacd1712ebe]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:22 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:22 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:23 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.778s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:23 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d 1G Aug 26 02:59:23 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:24 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d 1G" returned: 0 in 0.785s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:24 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d Aug 26 02:59:24 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:24 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d" returned: 0 in 0.487s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:24 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d is being set with open permissions: ugo+rw Aug 26 02:59:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:24 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d Aug 26 02:59:24 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:25 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d" returned: 0 in 0.592s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.868s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:25 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c72de180-4161-47f0-a546-ea7aa8938815 tempest-SnapshotsActionsTest-1376972385 None] Create snapshot completed successfully Aug 26 02:59:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-c07fdc5d-b779-40a0-a9a1-98c7e9abe48d-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-c07fdc5d-b779-40a0-a9a1-98c7e9abe48d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-quobyte-c07fdc5d-b779-40a0-a9a1-98c7e9abe48d" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-c07fdc5d-b779-40a0-a9a1-98c7e9abe48d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Deleting offline snapshot c07fdc5d-b779-40a0-a9a1-98c7e9abe48d of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] snapshot_file for this snap is: volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec9cea-c9a0-487a-9a08-29e3d206f0ee]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:26 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d Aug 26 02:59:26 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:26 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d" returned: 0 in 0.463s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d92a6f8-1e18-47eb-a62c-42f1e2d542d3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:26 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:26 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:27 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.749s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:27 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d Aug 26 02:59:27 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:28 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d" returned: 0 in 0.776s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:28 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d Aug 26 02:59:28 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:28 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.c07fdc5d-b779-40a0-a9a1-98c7e9abe48d" returned: 0 in 0.435s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-c07fdc5d-b779-40a0-a9a1-98c7e9abe48d" released by "_delete_snapshot" :: held 2.572s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" released by "delete_snapshot" :: held 2.611s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:28 devstack cinder-volume[93797]: WARNING cinder.quota [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:59:28 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Created reservations ['1ebee4f3-cbe1-4f96-bdb2-9d2076335bb2', '5afe855e-981c-4a2f-a6c9-6f4c55f8630b', '6794f215-b7fc-4c5c-8be4-b224ad0ab699', '2455f93f-ff35-43cb-ba4c-a6ee8d7f387e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Delete snapshot completed successfully. Aug 26 02:59:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-add6b62d-17f1-49ee-ac48-c0e43e60d384 tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-c07fdc5d-b779-40a0-a9a1-98c7e9abe48d-delete_snapshot" released by "delete_snapshot" :: held 2.872s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Creating offline snapshot 732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:30 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5289505-f2ff-4374-8a8a-0068a3f03dd7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:30 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:30 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:31 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.743s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:31 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee 1G Aug 26 02:59:31 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:31 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee 1G" returned: 0 in 0.847s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:31 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee Aug 26 02:59:31 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:32 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee" returned: 0 in 0.512s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:32 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee is being set with open permissions: ugo+rw Aug 26 02:59:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:32 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee Aug 26 02:59:32 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:32 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee" returned: 0 in 0.373s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-199be218-345d-49f2-9067-458c0728c564 tempest-SnapshotsActionsTest-1376972385 None] Create snapshot completed successfully Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-quobyte-732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Deleting offline snapshot 732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] snapshot_file for this snap is: volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96c1ff9-606a-4f4e-9f0e-4315f70e5ff4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:33 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee Aug 26 02:59:33 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:34 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee" returned: 0 in 0.734s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:34 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[352ce02b-db7f-4b10-bd4d-25ab43052912]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:34 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:34 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:35 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.801s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:35 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee Aug 26 02:59:35 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:35 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee" returned: 0 in 0.535s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:35 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee Aug 26 02:59:35 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:36 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee" returned: 0 in 0.304s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee" released by "_delete_snapshot" :: held 2.541s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" released by "delete_snapshot" :: held 2.585s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:36 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Created reservations ['8afeb1d5-0a9d-413f-b08a-ad1d24b43ab9', 'b0860380-dfdd-4a4f-9e7c-d58b4279f6b7', 'cbc1811e-bb58-4004-9656-645e44afea27', '742c9859-905d-4323-a99b-498883bff50a'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Delete snapshot completed successfully. Aug 26 02:59:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-aa17df94-2556-47f4-b7b1-b203fdf6260a tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-732cb4f2-35a1-4b0e-b4bc-1a8bc54433ee-delete_snapshot" released by "delete_snapshot" :: held 2.773s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Creating offline snapshot 7db24d86-2923-4205-a1c9-c7806d875b53 of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90b6b7-630c-4dc0-805c-84cf088f8cb5]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:37 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:37 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Flow 'volume_create_manager' (be0af27f-da22-4a04-840a-e9debf94da3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c1e670-0c8d-41a4-904d-55ee726f93ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c1e670-0c8d-41a4-904d-55ee726f93ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1258192771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3439ba-c407-4cf5-ba62-b011f1f2b2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a39bb0855641cdaf190e9256dfc507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:38Z,use_quota=True,user_id='3851b027998e42b3aac86871f45ae008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4406f91a-5aa0-49cb-8186-6b168b0ec1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4406f91a-5aa0-49cb-8186-6b168b0ec1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89fd0a4-597a-45a3-92b0-4bd17efa89a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89fd0a4-597a-45a3-92b0-4bd17efa89a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b3439ba-c407-4cf5-ba62-b011f1f2b2cf', 'volume_name': 'volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fde2e6-92ad-4181-a53c-904a2310d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fde2e6-92ad-4181-a53c-904a2310d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2834b4b-6e04-4ef3-bf08-7b5e8742c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:38 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Volume 9b3439ba-c407-4cf5-ba62-b011f1f2b2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf', 'volume_size': 1} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:38 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.644s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:38 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 1G Aug 26 02:59:38 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:39 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 1G" returned: 0 in 0.793s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:39 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 Aug 26 02:59:39 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:39 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53" returned: 0 in 0.515s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:39 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 is being set with open permissions: ugo+rw Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:39 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 Aug 26 02:59:39 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:39 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53" returned: 0 in 0.326s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.789s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1258192771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3439ba-c407-4cf5-ba62-b011f1f2b2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a39bb0855641cdaf190e9256dfc507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:38Z,use_quota=True,user_id='3851b027998e42b3aac86871f45ae008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Creating volume 9b3439ba-c407-4cf5-ba62-b011f1f2b2cf {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:59:39 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:59:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:40 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf 1073741824 Aug 26 02:59:40 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:40 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-02ef55d1-e21f-4e77-9f17-5f54246f9295 tempest-SnapshotsActionsTest-1376972385 None] Create snapshot completed successfully Aug 26 02:59:40 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf 1073741824" returned: 0 in 0.738s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:40 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf Aug 26 02:59:40 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-7db24d86-2923-4205-a1c9-c7806d875b53-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-7db24d86-2923-4205-a1c9-c7806d875b53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-quobyte-7db24d86-2923-4205-a1c9-c7806d875b53" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-7db24d86-2923-4205-a1c9-c7806d875b53" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Deleting offline snapshot 7db24d86-2923-4205-a1c9-c7806d875b53 of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] snapshot_file for this snap is: volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d761555e-2dc9-4e05-8908-400f363b58f4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:41 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf" returned: 0 in 0.453s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:41 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 Aug 26 02:59:41 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2834b4b-6e04-4ef3-bf08-7b5e8742c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5a444d-bf4a-474a-9b65-d8ab8c82160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:41 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Volume volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf (9b3439ba-c407-4cf5-ba62-b011f1f2b2cf): created successfully Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5a444d-bf4a-474a-9b65-d8ab8c82160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Flow 'volume_create_manager' (be0af27f-da22-4a04-840a-e9debf94da3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5e1d5e3b-7f82-4550-a8dc-7a18deb6e7f9 tempest-AttachVolumeShelveTestJSON-382280989 None] Created volume successfully. Aug 26 02:59:41 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53" returned: 0 in 0.516s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69dbc87-5bed-428f-ab2f-81475355d45b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:41 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:41 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:42 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.470s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:42 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 Aug 26 02:59:42 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:42 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53" returned: 0 in 0.522s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:42 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53 Aug 26 02:59:42 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:43 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7db24d86-2923-4205-a1c9-c7806d875b53" returned: 0 in 0.629s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-7db24d86-2923-4205-a1c9-c7806d875b53" released by "_delete_snapshot" :: held 2.297s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" released by "delete_snapshot" :: held 2.366s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:43 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Created reservations ['90314af6-de03-4225-9d0b-2bf74d85a972', '53b51aac-06fb-4903-b8af-fb6bffa80a40', '3c37025a-1a0a-40c5-925c-0e9a10dcbb38', '50130adf-d092-400d-a744-02274b4d2d0d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:43 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Delete snapshot completed successfully. Aug 26 02:59:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c46f725-5d66-4eeb-be77-c3bd4411446c tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-7db24d86-2923-4205-a1c9-c7806d875b53-delete_snapshot" released by "delete_snapshot" :: held 2.683s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Creating offline snapshot 7835b6d2-b747-4101-9255-01f6f8c2896c of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4364a5-e098-4dc9-bacc-df97752326fa]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:44 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:44 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:45 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.544s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:45 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c 1G Aug 26 02:59:45 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:45 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c 1G" returned: 0 in 0.621s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:45 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c Aug 26 02:59:45 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:46 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c" returned: 0 in 0.512s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:46 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c is being set with open permissions: ugo+rw Aug 26 02:59:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:46 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c Aug 26 02:59:46 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:46 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c" returned: 0 in 0.427s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-526ba781-cf3e-429a-9cde-5e1edebe32c7 tempest-SnapshotsActionsTest-1376972385 None] Create snapshot completed successfully Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-7835b6d2-b747-4101-9255-01f6f8c2896c-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-7835b6d2-b747-4101-9255-01f6f8c2896c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Acquiring lock "cinder-quobyte-7835b6d2-b747-4101-9255-01f6f8c2896c" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-7835b6d2-b747-4101-9255-01f6f8c2896c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Deleting offline snapshot 7835b6d2-b747-4101-9255-01f6f8c2896c of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] snapshot_file for this snap is: volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e2562b-53da-41d0-afca-cafe04d09306]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:48 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c Aug 26 02:59:48 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:48 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c" returned: 0 in 0.553s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f0458-be65-449d-9dcd-7ff913e4efa7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:49 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:49 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:49 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.598s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:49 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c Aug 26 02:59:49 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:50 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c" returned: 0 in 0.492s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:50 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c Aug 26 02:59:50 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:50 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.7835b6d2-b747-4101-9255-01f6f8c2896c" returned: 0 in 0.279s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-7835b6d2-b747-4101-9255-01f6f8c2896c" released by "_delete_snapshot" :: held 2.071s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" released by "delete_snapshot" :: held 2.096s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:50 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Created reservations ['e926c3a3-7620-4b1b-b698-8102502e7fa6', '6ea8d8fd-3676-4744-bacf-69d21cb037e8', 'f80f7cb2-a40d-4878-ac4c-801197a3d759', '7cc94556-b460-4906-8669-1a139210160f'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Delete snapshot completed successfully. Aug 26 02:59:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8220a6e0-7fbe-4d0b-b4ea-1c10456006ad tempest-SnapshotsActionsTest-944600487 None] Lock "cinder-7835b6d2-b747-4101-9255-01f6f8c2896c-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "cinder-8423ec76-3811-4923-8b9b-3baa411e5358-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-8423ec76-3811-4923-8b9b-3baa411e5358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "cinder-quobyte-8423ec76-3811-4923-8b9b-3baa411e5358" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-quobyte-8423ec76-3811-4923-8b9b-3baa411e5358" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Deleting offline snapshot 8423ec76-3811-4923-8b9b-3baa411e5358 of volume 043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] snapshot_file for this snap is: volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aeda24-3db1-4e66-ac1a-fae6da89a984]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:52 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:52 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.778s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043e5226-2a50-452a-825c-7ab980fd5654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:52 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbf8bc7-170b-47c0-bca0-0ab578e70b7b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:53 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 Aug 26 02:59:53 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:53 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654" returned: 0 in 0.531s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:53 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:53 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:54 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.681s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:54 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358 Aug 26 02:59:54 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:54 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654.8423ec76-3811-4923-8b9b-3baa411e5358" returned: 0 in 0.599s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-quobyte-8423ec76-3811-4923-8b9b-3baa411e5358" released by "_delete_snapshot" :: held 2.817s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" released by "delete_snapshot" :: held 2.870s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Flow 'volume_create_manager' (a620add7-a2ca-4294-8f63-c3f0fadc8952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975b14df-0459-4a7d-b084-1c14235ca928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975b14df-0459-4a7d-b084-1c14235ca928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1438862100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71716809-7247-4538-89fe-906c6ec72996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d9880a3e541048c808b8704d0efda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:55Z,use_quota=True,user_id='64aea7e8c42f497d8b01e01bea3b4d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5b314b-e09e-45ca-90bb-bcded7c9e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5b314b-e09e-45ca-90bb-bcded7c9e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7024f8a4-5963-49dc-b493-4866f70d09e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7024f8a4-5963-49dc-b493-4866f70d09e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71716809-7247-4538-89fe-906c6ec72996', 'volume_name': 'volume-71716809-7247-4538-89fe-906c6ec72996', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706f64d8-3ba2-4a49-b0bd-31c147af795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706f64d8-3ba2-4a49-b0bd-31c147af795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12abc8b4-4339-476c-8f5b-78d69fe699f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:55 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Volume 71716809-7247-4538-89fe-906c6ec72996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71716809-7247-4538-89fe-906c6ec72996', 'volume_size': 1} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1438862100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71716809-7247-4538-89fe-906c6ec72996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d9880a3e541048c808b8704d0efda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:55Z,use_quota=True,user_id='64aea7e8c42f497d8b01e01bea3b4d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Creating volume 71716809-7247-4538-89fe-906c6ec72996 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:59:55 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Created reservations ['df4d5e5e-b3b4-41f7-abac-8088148875e1', 'ffc9e440-216d-4e67-b912-08a410837f1e', '94e631d8-5069-4d52-8fed-02c2809418ee', 'b7dd064a-1742-4779-8d03-523fb151a118'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:55 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 1073741824 Aug 26 02:59:55 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:55 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Delete snapshot completed successfully. Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32303024-1aad-4f53-9d19-0e1ea4c44950 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-8423ec76-3811-4923-8b9b-3baa411e5358-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-b144bdfa-cdd0-4020-bd28-ac67fdfac1a6 req-515ac670-1aa1-453c-adba-de7ce28997af tempest-AttachVolumeShelveTestJSON-382280989 None] No connector for attachment c420b86a-9528-4bd6-b9c4-59079d1fdda8; skipping storage backend terminate_connection call. {{(pid=93797) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-b144bdfa-cdd0-4020-bd28-ac67fdfac1a6 req-515ac670-1aa1-453c-adba-de7ce28997af tempest-AttachVolumeShelveTestJSON-382280989 None] Deleting attachment c420b86a-9528-4bd6-b9c4-59079d1fdda8. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:59:55 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 1073741824" returned: 0 in 0.617s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:55 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 Aug 26 02:59:55 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:56 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996" returned: 0 in 0.379s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12abc8b4-4339-476c-8f5b-78d69fe699f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71716809-7247-4538-89fe-906c6ec72996', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1073eb71-6cd3-446d-8d04-a30c19040411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:56 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Volume volume-71716809-7247-4538-89fe-906c6ec72996 (71716809-7247-4538-89fe-906c6ec72996): created successfully Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1073eb71-6cd3-446d-8d04-a30c19040411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Flow 'volume_create_manager' (a620add7-a2ca-4294-8f63-c3f0fadc8952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7aa74041-9aa1-409d-98c0-c3316293e2a7 tempest-AttachVolumeTestJSON-496442869 None] Created volume successfully. Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "cinder-043e5226-2a50-452a-825c-7ab980fd5654-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-043e5226-2a50-452a-825c-7ab980fd5654-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f0613-9536-48da-92a5-2ed56e87057f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:56 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 Aug 26 02:59:56 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:57 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654" returned: 0 in 0.531s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:57 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654 Aug 26 02:59:57 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:57 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-043e5226-2a50-452a-825c-7ab980fd5654" returned: 0 in 0.405s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-quobyte-043e5226-2a50-452a-825c-7ab980fd5654" released by "delete_volume" :: held 1.046s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:57 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Created reservations ['b8d6031a-78d9-49ae-b0be-e770d186b6bd', '04af92a1-1e13-44c7-83b2-56ed173ec151', 'dd2e04d5-c67e-4d06-a545-71f7caa5d1f0', '0d1eaf0b-1501-4df0-ba9d-2031ce397c8e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:58 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 02:59:58 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-e7ce35c1-bd36-4dc7-9252-11dcadf9c481 req-5bdfbd3c-7d48-4419-8cb9-28dc13f0c732 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-e7ce35c1-bd36-4dc7-9252-11dcadf9c481 req-5bdfbd3c-7d48-4419-8cb9-28dc13f0c732 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-e7ce35c1-bd36-4dc7-9252-11dcadf9c481 req-5bdfbd3c-7d48-4419-8cb9-28dc13f0c732 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-e7ce35c1-bd36-4dc7-9252-11dcadf9c481 req-5bdfbd3c-7d48-4419-8cb9-28dc13f0c732 tempest-AttachVolumeTestJSON-496442869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-71716809-7247-4538-89fe-906c6ec72996', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7de82db-6b23-4d25-96b1-2eb1fda0cd3d', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:59:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-e7ce35c1-bd36-4dc7-9252-11dcadf9c481 req-5bdfbd3c-7d48-4419-8cb9-28dc13f0c732 tempest-AttachVolumeTestJSON-496442869 None] attachment_update completed successfully. Aug 26 02:59:58 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.380s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:59:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Deleted volume successfully. Aug 26 02:59:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc7f3250-4b45-416a-b427-eb10b4704018 tempest-SnapshotsActionsTest-1376972385 None] Lock "cinder-043e5226-2a50-452a-825c-7ab980fd5654-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Flow 'volume_create_manager' (d7f9980a-3de2-459f-9b12-1d72f0b566a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d1798c-8230-44dc-b850-e8952bec679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d1798c-8230-44dc-b850-e8952bec679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1842415856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e463a9-f053-43e7-afdc-399e566dff9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d9880a3e541048c808b8704d0efda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:01Z,use_quota=True,user_id='64aea7e8c42f497d8b01e01bea3b4d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fe024a-d99a-45bc-9b92-161626261c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fe024a-d99a-45bc-9b92-161626261c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04391ade-6d9a-441c-a76d-963fd8624586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04391ade-6d9a-441c-a76d-963fd8624586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e463a9-f053-43e7-afdc-399e566dff9a', 'volume_name': 'volume-04e463a9-f053-43e7-afdc-399e566dff9a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd723b2-a28c-4692-8db1-eb2b0cf54b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd723b2-a28c-4692-8db1-eb2b0cf54b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad7c032-50e6-4e6e-ad93-7d72e9678c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:01 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Volume 04e463a9-f053-43e7-afdc-399e566dff9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e463a9-f053-43e7-afdc-399e566dff9a', 'volume_size': 1} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1842415856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e463a9-f053-43e7-afdc-399e566dff9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d9880a3e541048c808b8704d0efda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:01Z,use_quota=True,user_id='64aea7e8c42f497d8b01e01bea3b4d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Creating volume 04e463a9-f053-43e7-afdc-399e566dff9a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:01 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:01 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a 1073741824 Aug 26 03:00:01 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:01 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:00:01 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:02 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a 1073741824" returned: 0 in 0.647s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:02 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a Aug 26 03:00:02 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:02 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a" returned: 0 in 0.337s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:02 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.455s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad7c032-50e6-4e6e-ad93-7d72e9678c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e463a9-f053-43e7-afdc-399e566dff9a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5036d6-3c67-4f4b-b3bf-2bf319d84ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:02 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Volume volume-04e463a9-f053-43e7-afdc-399e566dff9a (04e463a9-f053-43e7-afdc-399e566dff9a): created successfully Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5036d6-3c67-4f4b-b3bf-2bf319d84ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Flow 'volume_create_manager' (d7f9980a-3de2-459f-9b12-1d72f0b566a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:02 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f4957d96-d43f-4b3b-bb29-b344536bf113 tempest-AttachVolumeTestJSON-496442869 None] Created volume successfully. Aug 26 03:00:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-512c5a72-a624-48cc-941d-f75e2fb7c899 req-d13acbe2-2709-4161-b660-293f30501604 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-512c5a72-a624-48cc-941d-f75e2fb7c899 req-d13acbe2-2709-4161-b660-293f30501604 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-512c5a72-a624-48cc-941d-f75e2fb7c899 req-d13acbe2-2709-4161-b660-293f30501604 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-512c5a72-a624-48cc-941d-f75e2fb7c899 req-d13acbe2-2709-4161-b660-293f30501604 tempest-AttachVolumeTestJSON-496442869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-04e463a9-f053-43e7-afdc-399e566dff9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e5bdaa2-6106-4c4e-bd4b-cebacd98e0f8', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:00:04 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-512c5a72-a624-48cc-941d-f75e2fb7c899 req-d13acbe2-2709-4161-b660-293f30501604 tempest-AttachVolumeTestJSON-496442869 None] attachment_update completed successfully. Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Flow 'volume_create_manager' (bce52854-5096-43eb-ab57-6f89ff39b150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6026322-7c2b-4569-a6b6-66033eee9f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6026322-7c2b-4569-a6b6-66033eee9f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2095157340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe38740-02f3-4e71-97e1-c1760255560c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb79ddceba25434b9d36d984d11b4d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:08Z,use_quota=True,user_id='ef6b91f78e7348b2a7d1d81029c10855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d591ad-b98f-45c6-850a-8f21f697e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d591ad-b98f-45c6-850a-8f21f697e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6774efc-b651-48aa-8cbd-bd26abd6fc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6774efc-b651-48aa-8cbd-bd26abd6fc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe38740-02f3-4e71-97e1-c1760255560c', 'volume_name': 'volume-8fe38740-02f3-4e71-97e1-c1760255560c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4cd7b2-8307-4f48-89d0-57e2b1f81120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4cd7b2-8307-4f48-89d0-57e2b1f81120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e4f6c5-568c-4065-af3c-c13e7e02ee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:08 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Volume 8fe38740-02f3-4e71-97e1-c1760255560c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe38740-02f3-4e71-97e1-c1760255560c', 'volume_size': 1} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2095157340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe38740-02f3-4e71-97e1-c1760255560c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb79ddceba25434b9d36d984d11b4d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:08Z,use_quota=True,user_id='ef6b91f78e7348b2a7d1d81029c10855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Creating volume 8fe38740-02f3-4e71-97e1-c1760255560c {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:08 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:08 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c 1073741824 Aug 26 03:00:08 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-667d93b6-7bb9-4fe4-a52c-034763414240 req-a22b4e18-2ac8-4b5d-96d5-2a14bb0e571f tempest-AttachVolumeTestJSON-496442869 None] Terminate volume connection completed successfully. Aug 26 03:00:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-667d93b6-7bb9-4fe4-a52c-034763414240 req-a22b4e18-2ac8-4b5d-96d5-2a14bb0e571f tempest-AttachVolumeTestJSON-496442869 None] Deleting attachment a7de82db-6b23-4d25-96b1-2eb1fda0cd3d. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:00:08 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c 1073741824" returned: 0 in 0.657s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:09 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c Aug 26 03:00:09 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Flow 'volume_create_manager' (ef11d88f-ed7e-41a4-badc-099e49b5288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70368f1-a088-49fd-baaf-1882edde3abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=68,cinder:INSERT=14,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70368f1-a088-49fd-baaf-1882edde3abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-162800724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9769958-2964-4380-bc59-46f258543a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c7dbdda4d5483ab3037364f54404f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:09Z,use_quota=True,user_id='a65780ee0d784de48f3adda2e854032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907d7e7f-0235-4410-8a20-6779530dcb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907d7e7f-0235-4410-8a20-6779530dcb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6294d27-2315-440d-bc07-d87ce0cef752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6294d27-2315-440d-bc07-d87ce0cef752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9769958-2964-4380-bc59-46f258543a0d', 'volume_name': 'volume-e9769958-2964-4380-bc59-46f258543a0d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfc5057-2523-4406-9a5b-9ff823615d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfc5057-2523-4406-9a5b-9ff823615d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9defd9ed-54d8-414f-979c-459db3152fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Volume e9769958-2964-4380-bc59-46f258543a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9769958-2964-4380-bc59-46f258543a0d', 'volume_size': 1} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:09 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c" returned: 0 in 0.394s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-162800724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9769958-2964-4380-bc59-46f258543a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c7dbdda4d5483ab3037364f54404f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:09Z,use_quota=True,user_id='a65780ee0d784de48f3adda2e854032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Creating volume e9769958-2964-4380-bc59-46f258543a0d {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:09 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=58,cinder:SELECT=69,cinder:DELETE=5,cinder:INSERT=16 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:00:09 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d 1073741824 Aug 26 03:00:09 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e4f6c5-568c-4065-af3c-c13e7e02ee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe38740-02f3-4e71-97e1-c1760255560c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d43455-3626-4f08-9b14-817e3f59f91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Volume volume-8fe38740-02f3-4e71-97e1-c1760255560c (8fe38740-02f3-4e71-97e1-c1760255560c): created successfully Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d43455-3626-4f08-9b14-817e3f59f91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Flow 'volume_create_manager' (bce52854-5096-43eb-ab57-6f89ff39b150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-531fa069-8dce-4dbd-90a9-88bcb22f1311 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Created volume successfully. Aug 26 03:00:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-1697bfd3-9511-4be9-b5a2-96f5a2a9f530 req-ea27622c-c206-4d97-a9eb-da7f9dbbea19 tempest-AttachVolumeTestJSON-496442869 None] Terminate volume connection completed successfully. Aug 26 03:00:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-1697bfd3-9511-4be9-b5a2-96f5a2a9f530 req-ea27622c-c206-4d97-a9eb-da7f9dbbea19 tempest-AttachVolumeTestJSON-496442869 None] Deleting attachment 0e5bdaa2-6106-4c4e-bd4b-cebacd98e0f8. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:00:10 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d 1073741824" returned: 0 in 0.690s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:10 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d Aug 26 03:00:10 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:10 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d" returned: 0 in 0.414s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9defd9ed-54d8-414f-979c-459db3152fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9769958-2964-4380-bc59-46f258543a0d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf1a0e7-d0f8-49dc-8b7a-fa3fd83bbbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:10 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Volume volume-e9769958-2964-4380-bc59-46f258543a0d (e9769958-2964-4380-bc59-46f258543a0d): created successfully Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf1a0e7-d0f8-49dc-8b7a-fa3fd83bbbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Flow 'volume_create_manager' (ef11d88f-ed7e-41a4-badc-099e49b5288d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-efef197c-ce72-4de7-8dc6-1c5867d58948 tempest-AttachVolumeNegativeTest-1289338477 None] Created volume successfully. Aug 26 03:00:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Acquiring lock "cinder-8fe38740-02f3-4e71-97e1-c1760255560c-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "cinder-8fe38740-02f3-4e71-97e1-c1760255560c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Acquiring lock "cinder-quobyte-8fe38740-02f3-4e71-97e1-c1760255560c" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "cinder-quobyte-8fe38740-02f3-4e71-97e1-c1760255560c" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c9f54-a026-4f64-8d5b-d341e9c7b81b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:12 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c Aug 26 03:00:12 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-ca3171aa-970a-4702-aa78-5143bcae451f req-463799dc-03e2-4f43-ab04-2be6f5eddaa0 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-ca3171aa-970a-4702-aa78-5143bcae451f req-463799dc-03e2-4f43-ab04-2be6f5eddaa0 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-ca3171aa-970a-4702-aa78-5143bcae451f req-463799dc-03e2-4f43-ab04-2be6f5eddaa0 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-ca3171aa-970a-4702-aa78-5143bcae451f req-463799dc-03e2-4f43-ab04-2be6f5eddaa0 tempest-AttachVolumeNegativeTest-1289338477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-e9769958-2964-4380-bc59-46f258543a0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5389a832-8e53-42e8-a998-995876de6a34', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:00:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-ca3171aa-970a-4702-aa78-5143bcae451f req-463799dc-03e2-4f43-ab04-2be6f5eddaa0 tempest-AttachVolumeNegativeTest-1289338477 None] attachment_update completed successfully. Aug 26 03:00:13 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c" returned: 0 in 0.731s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:13 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c Aug 26 03:00:13 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:13 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8fe38740-02f3-4e71-97e1-c1760255560c" returned: 0 in 0.450s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "cinder-quobyte-8fe38740-02f3-4e71-97e1-c1760255560c" released by "delete_volume" :: held 1.224s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:13 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Created reservations ['248c8496-7a28-418f-bb0c-3fdfeda71050', 'aff37d88-e77b-42e9-b2b8-1dccd45e4cd5', '89682268-3583-426f-a4b0-a74e2c91e076', '832aeab1-d379-4f82-8363-8a631a8ca2c1'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:14 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:00:14 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:14 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.442s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:14 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Deleted volume successfully. Aug 26 03:00:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-416ee917-db95-422e-b00b-ea5bc918a305 tempest-VolumeQuotasNegativeTestJSON-2081113799 None] Lock "cinder-8fe38740-02f3-4e71-97e1-c1760255560c-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "cinder-04e463a9-f053-43e7-afdc-399e566dff9a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-04e463a9-f053-43e7-afdc-399e566dff9a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "cinder-quobyte-04e463a9-f053-43e7-afdc-399e566dff9a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-quobyte-04e463a9-f053-43e7-afdc-399e566dff9a" acquired by "delete_volume" :: waited 0.044s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f5fa0f-b35c-4890-b23b-f9e0317fe3dc]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:18 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a Aug 26 03:00:18 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:18 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a" returned: 0 in 0.468s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:18 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a Aug 26 03:00:18 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:18 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-04e463a9-f053-43e7-afdc-399e566dff9a" returned: 0 in 0.503s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-quobyte-04e463a9-f053-43e7-afdc-399e566dff9a" released by "delete_volume" :: held 1.064s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Created reservations ['656823d0-3bc2-4227-b692-5eee044b6845', 'b5b76ee8-105a-46af-8c1e-2f43fd561cd2', 'faf46621-2427-432b-87cf-80c7bffc215b', '1e5f617b-4e5a-45ff-a86c-8e07aeb8531c'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:19 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:00:19 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:19 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.363s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Deleted volume successfully. Aug 26 03:00:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-53c1f82a-c42b-49a2-995f-f31924c6371e tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-04e463a9-f053-43e7-afdc-399e566dff9a-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "cinder-71716809-7247-4538-89fe-906c6ec72996-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-71716809-7247-4538-89fe-906c6ec72996-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "cinder-quobyte-71716809-7247-4538-89fe-906c6ec72996" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-quobyte-71716809-7247-4538-89fe-906c6ec72996" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:20 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d3fe88-18a1-4f7d-bb44-87c244338758]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:20 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 Aug 26 03:00:20 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:20 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996" returned: 0 in 0.512s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:20 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996 Aug 26 03:00:20 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:21 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-71716809-7247-4538-89fe-906c6ec72996" returned: 0 in 0.407s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-quobyte-71716809-7247-4538-89fe-906c6ec72996" released by "delete_volume" :: held 0.991s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Created reservations ['52371b85-81b2-44aa-bb2e-c6334aa1556b', '54a94198-707b-445a-adff-59536e63e083', 'de57d177-225f-4cef-8da1-e102a15d85ac', '9fe50032-7aa0-4163-9984-0318cf0946e1'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:21 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:00:21 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:21 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:21 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Deleted volume successfully. Aug 26 03:00:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55760c25-c26c-4651-98e5-9ff4080dfaa0 tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-71716809-7247-4538-89fe-906c6ec72996-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "cinder-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "cinder-quobyte-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-quobyte-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0056e816-20c9-4f2f-897a-fd3efd827975]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:23 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 Aug 26 03:00:23 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:23 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6" returned: 0 in 0.733s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:23 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6 Aug 26 03:00:23 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:24 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6" returned: 0 in 0.410s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-quobyte-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6" released by "delete_volume" :: held 1.243s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Created reservations ['70be727d-d2d5-41ae-94d1-b0006ebbee6d', '606db40e-1b3d-44a5-a8af-eb663fd0c37d', 'acd62f69-91f3-4029-b6f2-52df0f28abc9', 'a9ef8261-3b36-4ac5-bbb1-561abc0dda85'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:24 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:00:24 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:24 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.371s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:24 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Deleted volume successfully. Aug 26 03:00:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4c3f3b91-878d-42d0-882f-3ec2405bfd9c tempest-AttachVolumeTestJSON-496442869 None] Lock "cinder-d397bc45-d9ad-49b6-af96-e0cf9ad14dc6-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:34 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=48,cinder:DELETE=3,cinder:SELECT=28,cinder:INSERT=11 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:00:34 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=29,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:00:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Acquiring lock "cinder-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "cinder-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Acquiring lock "cinder-quobyte-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "cinder-quobyte-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf" acquired by "delete_volume" :: waited 0.041s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:42 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[088ed3e8-5ec1-4f56-9c22-d3b227ca18ba]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:43 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf Aug 26 03:00:43 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:43 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf" returned: 0 in 0.463s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:43 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf Aug 26 03:00:43 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:43 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf" returned: 0 in 0.308s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "cinder-quobyte-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf" released by "delete_volume" :: held 0.838s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Created reservations ['c83edd53-5cc1-43e7-92ce-ccfa9504f1ed', '2f7153c2-d25c-402e-9a9d-2a0fdb99bfb6', '18753752-fad6-4ef1-b67d-2c55992127a6', '95d08793-a397-412c-b3b1-db15eb7bc412'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:43 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:00:43 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:44 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.321s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:44 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:44 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Deleted volume successfully. Aug 26 03:00:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c856af85-ca58-40ec-8b12-51913a7ede8c tempest-AttachVolumeShelveTestJSON-382280989 None] Lock "cinder-9b3439ba-c407-4cf5-ba62-b011f1f2b2cf-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Flow 'volume_create_manager' (b90bd56f-45b5-4610-9f68-ea3a85e28395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8ab0e7-a125-4096-bcdd-124bc7b07c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8ab0e7-a125-4096-bcdd-124bc7b07c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1970854207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc2c672-3d99-4256-9f0d-320b43d6e0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362780814ea43dfaa8123566a5e404a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:50Z,use_quota=True,user_id='d367a1eaf28a4f7ab896dc320d1e13aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb5c1b2-3ea7-45b8-8699-a5ea9390fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb5c1b2-3ea7-45b8-8699-a5ea9390fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdbb700-be6f-49c1-ac2a-85adc098c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdbb700-be6f-49c1-ac2a-85adc098c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc2c672-3d99-4256-9f0d-320b43d6e0ce', 'volume_name': 'volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7e9aeb-b192-4c29-b628-c957495eef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7e9aeb-b192-4c29-b628-c957495eef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127f028c-dd4c-42c2-bd89-be988e71cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Volume 1fc2c672-3d99-4256-9f0d-320b43d6e0ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce', 'volume_size': 1} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1970854207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc2c672-3d99-4256-9f0d-320b43d6e0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362780814ea43dfaa8123566a5e404a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:50Z,use_quota=True,user_id='d367a1eaf28a4f7ab896dc320d1e13aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Creating volume 1fc2c672-3d99-4256-9f0d-320b43d6e0ce {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:50 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:50 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce 1073741824 Aug 26 03:00:50 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Flow 'volume_create_manager' (d04e3b69-188c-4494-961a-f7d745959486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43569f8-0572-412c-85d3-d2f03302ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43569f8-0572-412c-85d3-d2f03302ba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1277024338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ef4238-9705-4c37-8ffd-f3c4216a68ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a873f57c6b64e9f87b68b616b75be09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:50Z,use_quota=True,user_id='495140be55db4b4b9037b3262d49e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd593a2-f1ce-4854-b312-405f45c80dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd593a2-f1ce-4854-b312-405f45c80dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a8da51-49cb-4ee3-8ecf-c7bf2fd47538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a8da51-49cb-4ee3-8ecf-c7bf2fd47538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ef4238-9705-4c37-8ffd-f3c4216a68ac', 'volume_name': 'volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bd6a42-19e8-44ba-9a58-6490b725e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bd6a42-19e8-44ba-9a58-6490b725e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33b972a-6e04-451e-b9bf-46b36ebe5a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:50 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Volume 37ef4238-9705-4c37-8ffd-f3c4216a68ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac', 'volume_size': 1} Aug 26 03:00:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:51 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce 1073741824" returned: 0 in 0.557s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:51 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce Aug 26 03:00:51 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:51 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce" returned: 0 in 0.262s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1277024338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ef4238-9705-4c37-8ffd-f3c4216a68ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a873f57c6b64e9f87b68b616b75be09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:50Z,use_quota=True,user_id='495140be55db4b4b9037b3262d49e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Creating volume 37ef4238-9705-4c37-8ffd-f3c4216a68ac {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:51 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127f028c-dd4c-42c2-bd89-be988e71cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:51 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac 1073741824 Aug 26 03:00:51 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747d087b-87bd-4372-9484-ac58cfa74083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:51 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Volume volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce (1fc2c672-3d99-4256-9f0d-320b43d6e0ce): created successfully Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747d087b-87bd-4372-9484-ac58cfa74083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Flow 'volume_create_manager' (b90bd56f-45b5-4610-9f68-ea3a85e28395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:51 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7c139f6a-c9c5-4608-8152-9e67100b6b60 tempest-VolumesTransfersTest-573773710 None] Created volume successfully. Aug 26 03:00:51 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac 1073741824" returned: 0 in 0.543s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:52 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac Aug 26 03:00:52 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:52 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac" returned: 0 in 0.297s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33b972a-6e04-451e-b9bf-46b36ebe5a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96026b33-eb52-4cd9-bc2b-db96084cf44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:52 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Volume volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac (37ef4238-9705-4c37-8ffd-f3c4216a68ac): created successfully Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96026b33-eb52-4cd9-bc2b-db96084cf44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Flow 'volume_create_manager' (d04e3b69-188c-4494-961a-f7d745959486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e3278c4d-426c-4b5d-a559-370ce9d3cd52 tempest-VolumeQuotasAdminTestJSON-308478803 None] Created volume successfully. Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Acquiring lock "cinder-37ef4238-9705-4c37-8ffd-f3c4216a68ac-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "cinder-37ef4238-9705-4c37-8ffd-f3c4216a68ac-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Acquiring lock "cinder-quobyte-37ef4238-9705-4c37-8ffd-f3c4216a68ac" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "cinder-quobyte-37ef4238-9705-4c37-8ffd-f3c4216a68ac" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae324590-ff84-4cb0-990d-b22231c0a3de]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:53 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac Aug 26 03:00:53 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:53 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac" returned: 0 in 0.436s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:53 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac Aug 26 03:00:53 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:53 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Flow 'volume_create_manager' (540206a4-a782-406d-b597-5f9052627614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5734030-24d1-4391-83a8-c66c596ab455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-37ef4238-9705-4c37-8ffd-f3c4216a68ac" returned: 0 in 0.357s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2ab55733-c1f5-425c-b7bf-f5a2c8b4dcde tempest-VolumesTransfersTest-1565160268 None] Transfer volume completed successfully. Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5734030-24d1-4391-83a8-c66c596ab455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-115328469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77917452-2a47-4ab5-9c98-da80bec0341f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f09d5739d8446f2b657963a8762c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:54Z,use_quota=True,user_id='39993ceb89d345a1a6c77a8c89a7d915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f320f36-9650-4889-8870-b27b974cfaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f320f36-9650-4889-8870-b27b974cfaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90d34b9-0072-4750-8dd8-e8815d23ea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90d34b9-0072-4750-8dd8-e8815d23ea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77917452-2a47-4ab5-9c98-da80bec0341f', 'volume_name': 'volume-77917452-2a47-4ab5-9c98-da80bec0341f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d34bae-85e9-4c4c-be65-8ce570c8fe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d34bae-85e9-4c4c-be65-8ce570c8fe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb65484e-0e99-4521-afaa-c0b8dd058ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:53 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Volume 77917452-2a47-4ab5-9c98-da80bec0341f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77917452-2a47-4ab5-9c98-da80bec0341f', 'volume_size': 1} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-115328469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77917452-2a47-4ab5-9c98-da80bec0341f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f09d5739d8446f2b657963a8762c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:54Z,use_quota=True,user_id='39993ceb89d345a1a6c77a8c89a7d915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Creating volume 77917452-2a47-4ab5-9c98-da80bec0341f {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:53 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "cinder-quobyte-37ef4238-9705-4c37-8ffd-f3c4216a68ac" released by "delete_volume" :: held 0.935s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:53 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f 1073741824 Aug 26 03:00:53 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Created reservations ['a5322b83-3801-409f-aa2c-b94b29f0456d', '24327346-4448-4ab6-b4c4-0d09d67e5bce', 'edc038a8-4c07-40a0-86af-73989f4484ee', 'cfdd4058-d573-42bd-8705-b702b5784335'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:54 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:00:54 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:54 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f 1073741824" returned: 0 in 0.551s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:54 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.318s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Deleted volume successfully. Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7eba2bd6-4d2a-49ed-ae11-e9d1ab6bfa13 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "cinder-37ef4238-9705-4c37-8ffd-f3c4216a68ac-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:54 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f Aug 26 03:00:54 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Acquiring lock "cinder-1fc2c672-3d99-4256-9f0d-320b43d6e0ce-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Lock "cinder-1fc2c672-3d99-4256-9f0d-320b43d6e0ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Acquiring lock "cinder-quobyte-1fc2c672-3d99-4256-9f0d-320b43d6e0ce" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Lock "cinder-quobyte-1fc2c672-3d99-4256-9f0d-320b43d6e0ce" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ac90c3-4758-44e0-abb4-4658bf2faf4a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:54 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f" returned: 0 in 0.340s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:54 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce Aug 26 03:00:54 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb65484e-0e99-4521-afaa-c0b8dd058ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77917452-2a47-4ab5-9c98-da80bec0341f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3126f3a-4119-4c7e-83e8-9cdeb648e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:54 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Volume volume-77917452-2a47-4ab5-9c98-da80bec0341f (77917452-2a47-4ab5-9c98-da80bec0341f): created successfully Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3126f3a-4119-4c7e-83e8-9cdeb648e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Flow 'volume_create_manager' (540206a4-a782-406d-b597-5f9052627614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-92c4a64a-3f84-4f1a-9281-ad0dcf39313c tempest-VolumesTestJSON-2050409912 None] Created volume successfully. Aug 26 03:00:55 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce" returned: 0 in 0.483s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:55 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce Aug 26 03:00:55 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:55 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1fc2c672-3d99-4256-9f0d-320b43d6e0ce" returned: 0 in 0.385s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Lock "cinder-quobyte-1fc2c672-3d99-4256-9f0d-320b43d6e0ce" released by "delete_volume" :: held 0.935s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Created reservations ['8dc56eb3-1789-4111-93e5-aa54352285a9', '6a807340-d88b-4756-a8e1-3caae4d08a48', '3ee97aac-6d49-4e97-88ab-c5567d6c2bac', '66b84adf-2a16-4ce8-8474-8432ebeb926a'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:55 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:00:55 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:55 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Flow 'volume_create_manager' (02d08c3c-cc81-4df3-8aa1-5858781e51a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4578ba5-5a64-4b09-9a6c-b843255e8e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4578ba5-5a64-4b09-9a6c-b843255e8e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-210336317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115d7957-8b19-4bf2-94ac-402e2ad824e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a873f57c6b64e9f87b68b616b75be09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:56Z,use_quota=True,user_id='495140be55db4b4b9037b3262d49e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d41c8b-796e-4fc2-9d92-c95b1e5e0f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d41c8b-796e-4fc2-9d92-c95b1e5e0f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5dec35-4ff6-4799-acd0-1243ff793d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5dec35-4ff6-4799-acd0-1243ff793d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '115d7957-8b19-4bf2-94ac-402e2ad824e0', 'volume_name': 'volume-115d7957-8b19-4bf2-94ac-402e2ad824e0', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5c91da-9487-4483-849b-03836eb3ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5c91da-9487-4483-849b-03836eb3ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac72e9f-dfb6-47e6-8298-c8b5ee2c9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:56 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Volume 115d7957-8b19-4bf2-94ac-402e2ad824e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-115d7957-8b19-4bf2-94ac-402e2ad824e0', 'volume_size': 1} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-210336317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115d7957-8b19-4bf2-94ac-402e2ad824e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a873f57c6b64e9f87b68b616b75be09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:56Z,use_quota=True,user_id='495140be55db4b4b9037b3262d49e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Creating volume 115d7957-8b19-4bf2-94ac-402e2ad824e0 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:56 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:56 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 1073741824 Aug 26 03:00:56 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:56 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.515s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Deleted volume successfully. Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0bc4a007-31e8-47f3-95ac-f753a7d0413b tempest-VolumesTransfersTest-1047572866 None] Lock "cinder-1fc2c672-3d99-4256-9f0d-320b43d6e0ce-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:56 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 1073741824" returned: 0 in 0.832s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:57 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 Aug 26 03:00:57 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Flow 'volume_create_manager' (c9922267-cb9e-4848-87e0-e943b744c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00414fd-dd7f-405f-99c5-ba35dae4009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00414fd-dd7f-405f-99c5-ba35dae4009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1961364102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541180e7-4faa-41c6-921e-40c7f784176e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362780814ea43dfaa8123566a5e404a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:57Z,use_quota=True,user_id='d367a1eaf28a4f7ab896dc320d1e13aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b05913d-1b6f-41c6-aa25-bc0653f8d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b05913d-1b6f-41c6-aa25-bc0653f8d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e4af7f-9f2b-4a32-9f9f-d43ce18eecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e4af7f-9f2b-4a32-9f9f-d43ce18eecf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541180e7-4faa-41c6-921e-40c7f784176e', 'volume_name': 'volume-541180e7-4faa-41c6-921e-40c7f784176e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fd5553-2046-4794-ade1-e765a0efc612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fd5553-2046-4794-ade1-e765a0efc612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55a1144-c806-4660-92dd-0ace56577ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Volume 541180e7-4faa-41c6-921e-40c7f784176e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541180e7-4faa-41c6-921e-40c7f784176e', 'volume_size': 1} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Flow 'volume_create_manager' (dc8d21e2-fc95-42bf-b519-5d0ed48c501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ac5bf9-0e4f-44c2-90af-3b8ab40d7a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ac5bf9-0e4f-44c2-90af-3b8ab40d7a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-735280476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68682217-dd5d-4f1a-83d3-d6e3b90293a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f09d5739d8446f2b657963a8762c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:57Z,use_quota=True,user_id='39993ceb89d345a1a6c77a8c89a7d915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66a3771-a71b-4efb-a808-3741faeaa850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66a3771-a71b-4efb-a808-3741faeaa850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd73970a-6126-4aff-805a-1857fb3db514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd73970a-6126-4aff-805a-1857fb3db514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68682217-dd5d-4f1a-83d3-d6e3b90293a4', 'volume_name': 'volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45618b9d-c2d8-4dc2-8119-7955952f8462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45618b9d-c2d8-4dc2-8119-7955952f8462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40baded3-6322-4597-b533-d85297803d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Volume 68682217-dd5d-4f1a-83d3-d6e3b90293a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4', 'volume_size': 1} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0" returned: 0 in 0.380s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1961364102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541180e7-4faa-41c6-921e-40c7f784176e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362780814ea43dfaa8123566a5e404a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:57Z,use_quota=True,user_id='d367a1eaf28a4f7ab896dc320d1e13aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Creating volume 541180e7-4faa-41c6-921e-40c7f784176e {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:57 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:57 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e 1073741824 Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac72e9f-dfb6-47e6-8298-c8b5ee2c9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115d7957-8b19-4bf2-94ac-402e2ad824e0', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ba807d-e84c-41b5-a962-ff426ce4b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:57 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Volume volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 (115d7957-8b19-4bf2-94ac-402e2ad824e0): created successfully Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ba807d-e84c-41b5-a962-ff426ce4b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Flow 'volume_create_manager' (02d08c3c-cc81-4df3-8aa1-5858781e51a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:57 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-cee3bd56-f611-4ace-b113-789363ddb2d9 tempest-VolumeQuotasAdminTestJSON-308478803 None] Created volume successfully. Aug 26 03:00:58 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e 1073741824" returned: 0 in 0.664s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:58 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e Aug 26 03:00:58 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:58 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e" returned: 0 in 0.305s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-735280476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68682217-dd5d-4f1a-83d3-d6e3b90293a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f09d5739d8446f2b657963a8762c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:57Z,use_quota=True,user_id='39993ceb89d345a1a6c77a8c89a7d915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Creating volume 68682217-dd5d-4f1a-83d3-d6e3b90293a4 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:58 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55a1144-c806-4660-92dd-0ace56577ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541180e7-4faa-41c6-921e-40c7f784176e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:58 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 1073741824 Aug 26 03:00:58 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c40409-5a29-4ceb-a87f-49bbc4caf668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Volume volume-541180e7-4faa-41c6-921e-40c7f784176e (541180e7-4faa-41c6-921e-40c7f784176e): created successfully Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c40409-5a29-4ceb-a87f-49bbc4caf668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Flow 'volume_create_manager' (c9922267-cb9e-4848-87e0-e943b744c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-33a0ee07-b685-42e3-87d2-f1fdd4a181c3 tempest-VolumesTransfersTest-573773710 None] Created volume successfully. Aug 26 03:00:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9498207c-3f2c-4fa0-aa52-626fe874793c tempest-VolumeQuotasAdminTestJSON-1323352738 None] Transfer volume completed successfully. Aug 26 03:00:58 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 1073741824" returned: 0 in 0.516s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:59 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 Aug 26 03:00:59 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Acquiring lock "cinder-541180e7-4faa-41c6-921e-40c7f784176e-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Lock "cinder-541180e7-4faa-41c6-921e-40c7f784176e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Acquiring lock "cinder-quobyte-541180e7-4faa-41c6-921e-40c7f784176e" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:59 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Lock "cinder-quobyte-541180e7-4faa-41c6-921e-40c7f784176e" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4" returned: 0 in 0.340s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[89763b1d-ae66-4675-8b8d-b4088ead84a4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40baded3-6322-4597-b533-d85297803d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fce595-2b21-457c-b9c5-ca4676fbdd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:59 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Volume volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 (68682217-dd5d-4f1a-83d3-d6e3b90293a4): created successfully Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fce595-2b21-457c-b9c5-ca4676fbdd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Flow 'volume_create_manager' (dc8d21e2-fc95-42bf-b519-5d0ed48c501f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Acquiring lock "cinder-115d7957-8b19-4bf2-94ac-402e2ad824e0-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-46c74e14-6251-480f-a313-00af70d66116 tempest-VolumesTestJSON-2050409912 None] Created volume successfully. Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Lock "cinder-115d7957-8b19-4bf2-94ac-402e2ad824e0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:59 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e Aug 26 03:00:59 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Acquiring lock "cinder-quobyte-115d7957-8b19-4bf2-94ac-402e2ad824e0" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Lock "cinder-quobyte-115d7957-8b19-4bf2-94ac-402e2ad824e0" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb82fb2-6f03-4f7e-bf99-ff0f2d3d4e47]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:59 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 Aug 26 03:00:59 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:59 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e" returned: 0 in 0.450s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:59 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e Aug 26 03:00:59 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:59 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0" returned: 0 in 0.430s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:00 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0 Aug 26 03:01:00 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:00 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-541180e7-4faa-41c6-921e-40c7f784176e" returned: 0 in 0.317s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Lock "cinder-quobyte-541180e7-4faa-41c6-921e-40c7f784176e" released by "delete_volume" :: held 0.825s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Created reservations ['9bf3007f-2ede-4a4f-8a2a-c95ce4865a0f', 'f98d241e-1626-4c16-a978-d3e3dabf1385', 'f7743672-9bdb-4512-a2b3-133d791e2bf9', 'b1556c4f-42b1-40fa-87c2-496f85e86dfd'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:00 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:00 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:00 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-115d7957-8b19-4bf2-94ac-402e2ad824e0" returned: 0 in 0.356s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Lock "cinder-quobyte-115d7957-8b19-4bf2-94ac-402e2ad824e0" released by "delete_volume" :: held 0.847s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Created reservations ['58abfb20-b2d8-4d72-a73b-9cd3f47dfd3e', '0768ac0a-b888-4342-883f-8df559144446', 'a1ba1474-2816-4625-9288-f04799cd33f4', '313716b2-5680-466e-b971-9dc89e64b5e1'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:00 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:00 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.503s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:00 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Deleted volume successfully. Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d71aa7b-e2ae-4ec5-b9b8-d544ca21b456 tempest-VolumesTransfersTest-1047572866 None] Lock "cinder-541180e7-4faa-41c6-921e-40c7f784176e-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Flow 'volume_create_manager' (ef849289-cb67-45c2-b3d1-a2b7e1b52768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea46ce2-df15-4486-9cb8-e81aa94337f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea46ce2-df15-4486-9cb8-e81aa94337f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-349366985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbda9878-1b6c-460d-9522-7045b06f727a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f09d5739d8446f2b657963a8762c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:01Z,use_quota=True,user_id='39993ceb89d345a1a6c77a8c89a7d915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b34dc5-85cd-4309-af02-94416948bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b34dc5-85cd-4309-af02-94416948bf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9ee380-a847-4f9f-a21a-586862954d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9ee380-a847-4f9f-a21a-586862954d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbda9878-1b6c-460d-9522-7045b06f727a', 'volume_name': 'volume-fbda9878-1b6c-460d-9522-7045b06f727a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995f4111-04eb-43f6-9da9-d419fe8f8bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995f4111-04eb-43f6-9da9-d419fe8f8bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71b176e-6ce1-41f1-821a-244c9e7e67fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:01 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Volume fbda9878-1b6c-460d-9522-7045b06f727a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbda9878-1b6c-460d-9522-7045b06f727a', 'volume_size': 1} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-349366985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbda9878-1b6c-460d-9522-7045b06f727a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f09d5739d8446f2b657963a8762c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:01Z,use_quota=True,user_id='39993ceb89d345a1a6c77a8c89a7d915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Creating volume fbda9878-1b6c-460d-9522-7045b06f727a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:01 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:01 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.526s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:01 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a 1073741824 Aug 26 03:01:01 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:01 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Deleted volume successfully. Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8c42bc03-8942-4e00-b6b5-71fe47ae1d1a tempest-VolumeQuotasAdminTestJSON-1540077497 None] Lock "cinder-115d7957-8b19-4bf2-94ac-402e2ad824e0-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:01 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a 1073741824" returned: 0 in 0.651s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:01 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-8317afc8-3d0a-4d16-a3ab-31c8243e1233 req-ba65d94a-fea3-4373-b5c7-e01efd2fbec1 tempest-AttachVolumeNegativeTest-1289338477 None] Terminate volume connection completed successfully. Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-8317afc8-3d0a-4d16-a3ab-31c8243e1233 req-ba65d94a-fea3-4373-b5c7-e01efd2fbec1 tempest-AttachVolumeNegativeTest-1289338477 None] Deleting attachment 5389a832-8e53-42e8-a998-995876de6a34. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:01 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a Aug 26 03:01:01 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:02 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:02 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:02 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a" returned: 0 in 0.357s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71b176e-6ce1-41f1-821a-244c9e7e67fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbda9878-1b6c-460d-9522-7045b06f727a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb1cf66-a7b3-4918-a32e-a09d0925a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:02 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Volume volume-fbda9878-1b6c-460d-9522-7045b06f727a (fbda9878-1b6c-460d-9522-7045b06f727a): created successfully Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb1cf66-a7b3-4918-a32e-a09d0925a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Flow 'volume_create_manager' (ef849289-cb67-45c2-b3d1-a2b7e1b52768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:02 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-cc5c2efc-d2bd-4acf-8bf5-18e8274200b1 tempest-VolumesTestJSON-2050409912 None] Created volume successfully. Aug 26 03:01:02 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.455s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:01:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:01:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Acquiring lock "cinder-fbda9878-1b6c-460d-9522-7045b06f727a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Lock "cinder-fbda9878-1b6c-460d-9522-7045b06f727a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Acquiring lock "cinder-quobyte-fbda9878-1b6c-460d-9522-7045b06f727a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Lock "cinder-quobyte-fbda9878-1b6c-460d-9522-7045b06f727a" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:04 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1350e7ac-999f-455c-9ecb-07f51a43dfe3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:04 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a Aug 26 03:01:04 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:05 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a" returned: 0 in 0.471s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:05 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a Aug 26 03:01:05 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:05 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fbda9878-1b6c-460d-9522-7045b06f727a" returned: 0 in 0.301s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Lock "cinder-quobyte-fbda9878-1b6c-460d-9522-7045b06f727a" released by "delete_volume" :: held 0.834s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Created reservations ['2933437e-b7ca-4035-aed2-6325be561fa6', '468f26de-3a38-4196-a0e7-d50686765324', 'be8bed7d-c60a-4968-91b3-571c550bce5f', 'c9a81e96-bb85-4498-922c-2859c6c097af'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:05 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:05 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "cinder-68682217-dd5d-4f1a-83d3-d6e3b90293a4-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Lock "cinder-68682217-dd5d-4f1a-83d3-d6e3b90293a4-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "cinder-quobyte-68682217-dd5d-4f1a-83d3-d6e3b90293a4" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Lock "cinder-quobyte-68682217-dd5d-4f1a-83d3-d6e3b90293a4" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3879d0-903f-40c1-b6c5-dad65db3f804]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:06 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.388s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Deleted volume successfully. Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fc6a456-3d71-49ed-af65-b571e893eb4c tempest-VolumesTestJSON-2050409912 None] Lock "cinder-fbda9878-1b6c-460d-9522-7045b06f727a-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:06 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 Aug 26 03:01:06 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:06 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4" returned: 0 in 0.602s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:06 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4 Aug 26 03:01:06 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:07 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-68682217-dd5d-4f1a-83d3-d6e3b90293a4" returned: 0 in 0.350s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Lock "cinder-quobyte-68682217-dd5d-4f1a-83d3-d6e3b90293a4" released by "delete_volume" :: held 1.038s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Created reservations ['92082b0e-c1f7-4116-8e8e-c99938754cad', 'b54c16c0-03d4-4aec-a090-b94af41b4188', '8bfb7731-d63c-475a-95bf-ea69323265e4', 'c3b2db73-837f-407a-9a91-3c1a8d857f71'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:07 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:07 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:07 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.287s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:07 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Deleted volume successfully. Aug 26 03:01:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2af080ba-6a1d-406f-8d97-8d5f3cd73fa4 tempest-VolumesTestJSON-2050409912 None] Lock "cinder-68682217-dd5d-4f1a-83d3-d6e3b90293a4-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "cinder-77917452-2a47-4ab5-9c98-da80bec0341f-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Lock "cinder-77917452-2a47-4ab5-9c98-da80bec0341f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "cinder-quobyte-77917452-2a47-4ab5-9c98-da80bec0341f" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Lock "cinder-quobyte-77917452-2a47-4ab5-9c98-da80bec0341f" acquired by "delete_volume" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:08 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[993da03b-d862-48a4-be5b-03fc4b21e222]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:08 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f Aug 26 03:01:08 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:09 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f" returned: 0 in 0.541s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:09 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f Aug 26 03:01:09 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:09 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77917452-2a47-4ab5-9c98-da80bec0341f" returned: 0 in 0.389s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Lock "cinder-quobyte-77917452-2a47-4ab5-9c98-da80bec0341f" released by "delete_volume" :: held 1.011s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Created reservations ['e862c35e-aa17-4e5b-a8ac-d91046e6b13d', 'e30efacd-bfa2-45e1-af7e-402b42122eac', '8d656d1a-da58-44b7-8f46-e931396d513a', 'dff5389a-4d80-482a-9ce4-524f067b4ddd'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:09 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:09 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:09 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.316s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:09 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Deleted volume successfully. Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-70522e66-f5a0-4e73-9eb7-4c5db17e6ec0 tempest-VolumesTestJSON-2050409912 None] Lock "cinder-77917452-2a47-4ab5-9c98-da80bec0341f-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Flow 'volume_create_manager' (23c4a3fb-8a7c-4894-bfec-f9446d996a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9c4b95-5345-422a-b47c-8d36002d3417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9c4b95-5345-422a-b47c-8d36002d3417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-384287992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf05521103834f459749b70216a4e089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:11Z,use_quota=True,user_id='1180d7fdb0f04068b414036d44b8aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aeaa9c6-c467-451a-8b84-188c9c8ee1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aeaa9c6-c467-451a-8b84-188c9c8ee1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b388f75-ed0e-4d76-8aed-a812c322f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b388f75-ed0e-4d76-8aed-a812c322f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61', 'volume_name': 'volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996fe15f-d7d9-46bf-bccc-cc83674f6916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996fe15f-d7d9-46bf-bccc-cc83674f6916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6133e932-6b9e-4655-9695-80e358735d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:10 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Volume dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61', 'volume_size': 1} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-384287992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf05521103834f459749b70216a4e089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:11Z,use_quota=True,user_id='1180d7fdb0f04068b414036d44b8aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Creating volume dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:10 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:10 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 1073741824 Aug 26 03:01:10 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:11 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 1073741824" returned: 0 in 0.624s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:11 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 Aug 26 03:01:11 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:11 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61" returned: 0 in 0.322s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6133e932-6b9e-4655-9695-80e358735d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09cf33a-7674-41e2-ac93-c915627504e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:11 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Volume volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 (dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61): created successfully Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09cf33a-7674-41e2-ac93-c915627504e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Flow 'volume_create_manager' (23c4a3fb-8a7c-4894-bfec-f9446d996a9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7f3000bb-2678-4e10-ace5-5a2c7df7261c tempest-VolumesListTestJSON-1176648564 None] Created volume successfully. Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Flow 'volume_create_manager' (5dfb9f85-9cb1-4496-90ca-329e53e8db91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbca6f2b-e900-4b57-95cf-323a05c25f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbca6f2b-e900-4b57-95cf-323a05c25f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1587391034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3deef847-a253-4ccb-9790-1fa7d07fd906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ac5d54db74d1486d40304c0f233ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:12Z,use_quota=True,user_id='60799d47d05a4925b4794764274c0821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d620fa-2669-46f5-8663-825c73fdd06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d620fa-2669-46f5-8663-825c73fdd06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b5cbc0-d983-4d3f-a4cb-29ac624c517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b5cbc0-d983-4d3f-a4cb-29ac624c517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3deef847-a253-4ccb-9790-1fa7d07fd906', 'volume_name': 'volume-3deef847-a253-4ccb-9790-1fa7d07fd906', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f306094-1fad-4a84-9c71-0f07a394f35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f306094-1fad-4a84-9c71-0f07a394f35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aacec27-d3e3-4f6d-9a47-7ba109c8c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:12 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Volume 3deef847-a253-4ccb-9790-1fa7d07fd906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3deef847-a253-4ccb-9790-1fa7d07fd906', 'volume_size': 1} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1587391034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3deef847-a253-4ccb-9790-1fa7d07fd906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ac5d54db74d1486d40304c0f233ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:12Z,use_quota=True,user_id='60799d47d05a4925b4794764274c0821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Creating volume 3deef847-a253-4ccb-9790-1fa7d07fd906 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:12 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:12 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 1073741824 Aug 26 03:01:12 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:12 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 1073741824" returned: 0 in 0.582s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:12 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 Aug 26 03:01:12 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:13 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906" returned: 0 in 0.326s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aacec27-d3e3-4f6d-9a47-7ba109c8c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3deef847-a253-4ccb-9790-1fa7d07fd906', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56539891-8b86-45af-9afc-a042052c7f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:13 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Volume volume-3deef847-a253-4ccb-9790-1fa7d07fd906 (3deef847-a253-4ccb-9790-1fa7d07fd906): created successfully Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56539891-8b86-45af-9afc-a042052c7f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Flow 'volume_create_manager' (5dfb9f85-9cb1-4496-90ca-329e53e8db91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d1e5a7c3-b70d-448a-a6bd-7603ce5d9855 tempest-VolumesServicesTestJSON-739085793 None] Created volume successfully. Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Flow 'volume_create_manager' (f942a1cb-9ec2-4abd-a226-23f0b551b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23278f00-2d6f-45a0-a691-2e0983fdda54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23278f00-2d6f-45a0-a691-2e0983fdda54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1927580321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fabe33-a857-4d2c-a516-c904713b43d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf05521103834f459749b70216a4e089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:13Z,use_quota=True,user_id='1180d7fdb0f04068b414036d44b8aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfc82ab-5f32-4875-9681-40504ff64376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfc82ab-5f32-4875-9681-40504ff64376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6688f235-4099-47ac-8508-d09b9e6ddbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6688f235-4099-47ac-8508-d09b9e6ddbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76fabe33-a857-4d2c-a516-c904713b43d1', 'volume_name': 'volume-76fabe33-a857-4d2c-a516-c904713b43d1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b71eeb-43ab-4bac-bd36-6654675bf5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b71eeb-43ab-4bac-bd36-6654675bf5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482504fa-5b06-48dc-ba6d-f7f41d8549a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:13 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Volume 76fabe33-a857-4d2c-a516-c904713b43d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76fabe33-a857-4d2c-a516-c904713b43d1', 'volume_size': 1} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1927580321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fabe33-a857-4d2c-a516-c904713b43d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf05521103834f459749b70216a4e089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:13Z,use_quota=True,user_id='1180d7fdb0f04068b414036d44b8aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Creating volume 76fabe33-a857-4d2c-a516-c904713b43d1 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:13 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:13 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 1073741824 Aug 26 03:01:13 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:14 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 1073741824" returned: 0 in 0.610s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:14 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 Aug 26 03:01:14 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Acquiring lock "cinder-3deef847-a253-4ccb-9790-1fa7d07fd906-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Lock "cinder-3deef847-a253-4ccb-9790-1fa7d07fd906-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Acquiring lock "cinder-quobyte-3deef847-a253-4ccb-9790-1fa7d07fd906" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Lock "cinder-quobyte-3deef847-a253-4ccb-9790-1fa7d07fd906" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a606cf61-3f19-4376-b124-257cefa2d790]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:14 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1" returned: 0 in 0.432s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482504fa-5b06-48dc-ba6d-f7f41d8549a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76fabe33-a857-4d2c-a516-c904713b43d1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:14 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 Aug 26 03:01:14 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0923f9e2-80c6-49cb-8498-e4213889b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:14 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Volume volume-76fabe33-a857-4d2c-a516-c904713b43d1 (76fabe33-a857-4d2c-a516-c904713b43d1): created successfully Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0923f9e2-80c6-49cb-8498-e4213889b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Flow 'volume_create_manager' (f942a1cb-9ec2-4abd-a226-23f0b551b08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:14 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a70b9f8b-fc97-4d1e-8b5d-549e662aae4b tempest-VolumesListTestJSON-1176648564 None] Created volume successfully. Aug 26 03:01:15 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906" returned: 0 in 0.584s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:15 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906 Aug 26 03:01:15 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:15 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3deef847-a253-4ccb-9790-1fa7d07fd906" returned: 0 in 0.356s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Lock "cinder-quobyte-3deef847-a253-4ccb-9790-1fa7d07fd906" released by "delete_volume" :: held 1.033s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Created reservations ['e9140618-2bfb-4407-b0e0-0ff777dd8cde', '253c9991-8b5c-463c-af16-a9fc79ea2f07', 'abbb12ef-9b14-4aa4-83d1-6ca4770d6c65', 'b1d67655-2ff4-4ba0-a653-c5e506b5af53'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:15 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:15 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:16 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.376s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Deleted volume successfully. Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0025e583-822d-4632-a4e2-97a465f61ae4 tempest-VolumesServicesTestJSON-739085793 None] Lock "cinder-3deef847-a253-4ccb-9790-1fa7d07fd906-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-44f30281-607a-4a34-b5a9-8c2ec78553b6 tempest-GroupSnapshotsV319Test-1294855287 None] Group tempest-GroupSnapshotsV319Test-Group-775675971: creating Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Flow 'volume_create_manager' (b429c588-077b-4bd8-9123-87a41d32464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da14530-8e73-4ad0-aebe-ac843f5e218e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-44f30281-607a-4a34-b5a9-8c2ec78553b6 tempest-GroupSnapshotsV319Test-1294855287 None] Group tempest-GroupSnapshotsV319Test-Group-775675971: created successfully Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da14530-8e73-4ad0-aebe-ac843f5e218e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1206399265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f1b101-5516-4bff-bcfd-0ce4ec626735,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf05521103834f459749b70216a4e089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:16Z,use_quota=True,user_id='1180d7fdb0f04068b414036d44b8aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c67b85-384b-444f-92d4-932c663cc4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c67b85-384b-444f-92d4-932c663cc4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68a70cf-02de-4e74-a2e5-a52aca85239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68a70cf-02de-4e74-a2e5-a52aca85239e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f1b101-5516-4bff-bcfd-0ce4ec626735', 'volume_name': 'volume-79f1b101-5516-4bff-bcfd-0ce4ec626735', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f5e9a7-2411-4e87-b890-4a63f90d5e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f5e9a7-2411-4e87-b890-4a63f90d5e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6fd349-daac-498b-a620-f3f864fe28f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Volume 79f1b101-5516-4bff-bcfd-0ce4ec626735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f1b101-5516-4bff-bcfd-0ce4ec626735', 'volume_size': 1} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1206399265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f1b101-5516-4bff-bcfd-0ce4ec626735,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf05521103834f459749b70216a4e089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:16Z,use_quota=True,user_id='1180d7fdb0f04068b414036d44b8aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Creating volume 79f1b101-5516-4bff-bcfd-0ce4ec626735 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:16 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-44f30281-607a-4a34-b5a9-8c2ec78553b6 tempest-GroupSnapshotsV319Test-1294855287 None] Create group completed successfully. Aug 26 03:01:16 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 1073741824 Aug 26 03:01:16 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:17 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 1073741824" returned: 0 in 0.621s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:17 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 Aug 26 03:01:17 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:17 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735" returned: 0 in 0.518s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6fd349-daac-498b-a620-f3f864fe28f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f1b101-5516-4bff-bcfd-0ce4ec626735', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b764e61e-8db0-4766-b944-b8688d2bbd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:17 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Volume volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 (79f1b101-5516-4bff-bcfd-0ce4ec626735): created successfully Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b764e61e-8db0-4766-b944-b8688d2bbd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Flow 'volume_create_manager' (b429c588-077b-4bd8-9123-87a41d32464a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-68fe7eca-d6cd-4814-b561-0a457632ad3f tempest-VolumesListTestJSON-1176648564 None] Created volume successfully. Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Flow 'volume_create_manager' (7fe877f0-3cc7-4af2-80b5-250f896386d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151bb564-a855-45af-b541-a2d183040e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151bb564-a855-45af-b541-a2d183040e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1422324672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0aec3659-2ad9-4961-b525-2c61ef751aa2,host='devstack@QuobyteHD#QuobyteHD',id=c33926f5-be34-4d5b-a2af-ae80a0cbfd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7996a4413f4f5bb9ea4bc1341d0c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:18Z,use_quota=True,user_id='44739faceaf349268248f0aa65f7fb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbe0fdfe-39c1-4106-970e-198a50b353fa),volume_type_id=bbe0fdfe-39c1-4106-970e-198a50b353fa)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97db4b89-672d-4493-b1b7-4c736384d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97db4b89-672d-4493-b1b7-4c736384d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fa900c-b268-48ff-b62c-a842b607c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fa900c-b268-48ff-b62c-a842b607c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33926f5-be34-4d5b-a2af-ae80a0cbfd1e', 'volume_name': 'volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c193eb-bc2e-4e18-a377-4d2bfc338360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c193eb-bc2e-4e18-a377-4d2bfc338360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfeb933f-4adf-467a-9c93-90ea2ac586ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:18 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Volume c33926f5-be34-4d5b-a2af-ae80a0cbfd1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e', 'volume_size': 1} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0aec3659-2ad9-4961-b525-2c61ef751aa2,created_at=2026-08-26T01:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1422324672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0aec3659-2ad9-4961-b525-2c61ef751aa2,host='devstack@QuobyteHD#QuobyteHD',id=c33926f5-be34-4d5b-a2af-ae80a0cbfd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7996a4413f4f5bb9ea4bc1341d0c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:18Z,use_quota=True,user_id='44739faceaf349268248f0aa65f7fb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbe0fdfe-39c1-4106-970e-198a50b353fa),volume_type_id=bbe0fdfe-39c1-4106-970e-198a50b353fa)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Creating volume c33926f5-be34-4d5b-a2af-ae80a0cbfd1e {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:18 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:18 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e 1073741824 Aug 26 03:01:18 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:19 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e 1073741824" returned: 0 in 1.103s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:19 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e Aug 26 03:01:19 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:20 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" returned: 0 in 0.487s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfeb933f-4adf-467a-9c93-90ea2ac586ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2012800f-9f22-44a4-93c7-41381fa5a8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:20 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Volume volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e (c33926f5-be34-4d5b-a2af-ae80a0cbfd1e): created successfully Aug 26 03:01:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2012800f-9f22-44a4-93c7-41381fa5a8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Flow 'volume_create_manager' (7fe877f0-3cc7-4af2-80b5-250f896386d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c09581b8-c6dc-421b-95fc-2a3a5182389e tempest-GroupSnapshotsV319Test-1294855287 None] Created volume successfully. Aug 26 03:01:21 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] GroupSnapshot 25cb3b39-f0ff-441f-8de6-46bede5299b7: creating. Aug 26 03:01:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Group snapshot 25cb3b39-f0ff-441f-8de6-46bede5299b7: creating. {{(pid=93797) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 03:01:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Creating offline snapshot df713ac7-ad58-473c-a5c2-5dcf6f21075e of volume c33926f5-be34-4d5b-a2af-ae80a0cbfd1e {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:01:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e82853e-96c4-4dc5-b498-a2e8717a8e4b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:21 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e Aug 26 03:01:21 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:22 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" returned: 0 in 0.952s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:22 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e 1G Aug 26 03:01:22 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:23 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e 1G" returned: 0 in 0.685s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:23 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e Aug 26 03:01:23 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "cinder-79f1b101-5516-4bff-bcfd-0ce4ec626735-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-79f1b101-5516-4bff-bcfd-0ce4ec626735-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "cinder-quobyte-79f1b101-5516-4bff-bcfd-0ce4ec626735" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-quobyte-79f1b101-5516-4bff-bcfd-0ce4ec626735" acquired by "delete_volume" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2561f27e-9aad-4173-83bb-8615fb914147]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:23 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 Aug 26 03:01:23 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:24 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e" returned: 0 in 0.738s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:24 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:24 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e Aug 26 03:01:24 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:24 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735" returned: 0 in 0.837s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:24 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735 Aug 26 03:01:24 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:24 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e" returned: 0 in 0.707s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:24 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.info Aug 26 03:01:24 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:25 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-79f1b101-5516-4bff-bcfd-0ce4ec626735" returned: 0 in 0.399s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-quobyte-79f1b101-5516-4bff-bcfd-0ce4ec626735" released by "delete_volume" :: held 1.365s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Created reservations ['11ec49ae-de80-4cc5-be9f-b6bd458a931e', '63996821-a922-498d-b52c-e487ffac4525', '85947a47-e45f-4d43-b820-ed79b2110ba8', 'bd0f8916-efbf-44c7-8e32-605be8f308f7'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:25 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:25 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:25 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.info" returned: 0 in 0.690s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:25 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:25 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.info Aug 26 03:01:25 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:26 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.581s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Deleted volume successfully. Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-55a72878-f9bb-4537-a9e5-15a2d97d3678 tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-79f1b101-5516-4bff-bcfd-0ce4ec626735-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:26 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "cinder-76fabe33-a857-4d2c-a516-c904713b43d1-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.info" returned: 0 in 0.712s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.712s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-76fabe33-a857-4d2c-a516-c904713b43d1-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "cinder-quobyte-76fabe33-a857-4d2c-a516-c904713b43d1" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-quobyte-76fabe33-a857-4d2c-a516-c904713b43d1" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[773164e8-7199-4ede-b709-943038ef6be4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d02bb839-00cf-4f81-8719-6d922de43e70 tempest-GroupSnapshotsV319Test-1294855287 None] group_snapshot 25cb3b39-f0ff-441f-8de6-46bede5299b7: created successfully Aug 26 03:01:26 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 Aug 26 03:01:26 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:27 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1" returned: 0 in 0.539s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:27 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1 Aug 26 03:01:27 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:27 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76fabe33-a857-4d2c-a516-c904713b43d1" returned: 0 in 0.425s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-quobyte-76fabe33-a857-4d2c-a516-c904713b43d1" released by "delete_volume" :: held 1.036s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Created reservations ['4deaf7a9-3f16-41a0-81d2-e6fecc583309', '6402081b-fcfe-457f-bded-93859a74d479', '1d212f8d-4033-45df-8e56-13c21a1dc03a', 'c932f4ed-7d42-42b8-8bff-546f605d81bb'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:28 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:28 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] group_snapshot 25cb3b39-f0ff-441f-8de6-46bede5299b7: deleting Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] group_snapshot 25cb3b39-f0ff-441f-8de6-46bede5299b7: deleting {{(pid=93797) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Acquiring lock "cinder-quobyte-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Lock "cinder-quobyte-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Acquiring lock "cinder-quobyte-df713ac7-ad58-473c-a5c2-5dcf6f21075e" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:28 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Flow 'volume_create_manager' (d5ebd01a-33d0-49eb-b4cc-a3d4f1547ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3c5cd7-c582-4a3f-91b3-1a5181ceea1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.440s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Lock "cinder-quobyte-df713ac7-ad58-473c-a5c2-5dcf6f21075e" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Deleting offline snapshot df713ac7-ad58-473c-a5c2-5dcf6f21075e of volume c33926f5-be34-4d5b-a2af-ae80a0cbfd1e {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] snapshot_file for this snap is: volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:01:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Deleted volume successfully. Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3c5cd7-c582-4a3f-91b3-1a5181ceea1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-27186064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a63b697-a4a4-4b25-809d-267f63cabb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='860c99bf984046b099dfb42d41b8f5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:28Z,use_quota=True,user_id='06da09f224b44490b990b9719e69cb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4600d9-afaf-4d7f-b7a4-a9b0bd051f9b),volume_type_id=ca4600d9-afaf-4d7f-b7a4-a9b0bd051f9b)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfa5c90-e44c-4731-9e87-869fdc59b426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfa5c90-e44c-4731-9e87-869fdc59b426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cdc0bc-8eca-4a8d-a00d-ed9f0586ab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cdc0bc-8eca-4a8d-a00d-ed9f0586ab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a63b697-a4a4-4b25-809d-267f63cabb4a', 'volume_name': 'volume-2a63b697-a4a4-4b25-809d-267f63cabb4a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337bfdbe-614a-4be9-9d35-2b6a23fd649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337bfdbe-614a-4be9-9d35-2b6a23fd649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcc18ec-b0e0-4fc6-bd2e-2d802bb14898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Volume 2a63b697-a4a4-4b25-809d-267f63cabb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a63b697-a4a4-4b25-809d-267f63cabb4a', 'volume_size': 1} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-27186064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a63b697-a4a4-4b25-809d-267f63cabb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='860c99bf984046b099dfb42d41b8f5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:28Z,use_quota=True,user_id='06da09f224b44490b990b9719e69cb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4600d9-afaf-4d7f-b7a4-a9b0bd051f9b),volume_type_id=ca4600d9-afaf-4d7f-b7a4-a9b0bd051f9b)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Creating volume 2a63b697-a4a4-4b25-809d-267f63cabb4a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:28 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[de692525-8539-447c-be1c-16806925c9ea]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:28 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a 1073741824 Aug 26 03:01:28 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-93df42cc-22ce-4b24-b534-472297b5ec26 tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-76fabe33-a857-4d2c-a516-c904713b43d1-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:28 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e Aug 26 03:01:28 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "cinder-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "cinder-quobyte-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-quobyte-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fda5d71-172f-4a5e-836e-6fb44d4c75b3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:29 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e" returned: 0 in 0.492s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52f39c2-f630-48e3-93cf-3c170d83bf5d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:29 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a 1073741824" returned: 0 in 0.569s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:29 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 Aug 26 03:01:29 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:29 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a Aug 26 03:01:29 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:29 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e Aug 26 03:01:29 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:29 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a" returned: 0 in 0.291s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:29 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61" returned: 0 in 0.451s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcc18ec-b0e0-4fc6-bd2e-2d802bb14898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a63b697-a4a4-4b25-809d-267f63cabb4a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a5ca86-4db7-4f88-8609-b97e19f0bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:29 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61 Aug 26 03:01:29 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:29 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Volume volume-2a63b697-a4a4-4b25-809d-267f63cabb4a (2a63b697-a4a4-4b25-809d-267f63cabb4a): created successfully Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a5ca86-4db7-4f88-8609-b97e19f0bff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Flow 'volume_create_manager' (d5ebd01a-33d0-49eb-b4cc-a3d4f1547ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-afceba66-1ebc-4f2c-8cfa-7d96613a4148 tempest-VolumeTypesAccessTest-1292736974 None] Created volume successfully. Aug 26 03:01:29 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" returned: 0 in 0.548s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:29 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e Aug 26 03:01:29 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:29 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61" returned: 0 in 0.307s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-quobyte-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61" released by "delete_volume" :: held 0.813s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Created reservations ['c34dfaaf-4ff2-4177-8cd9-fa2b8bb4b8c2', '6e610414-8440-456f-8c36-2dd0caf605c8', '398be83d-4e83-44cc-8af1-831012943236', 'c13b646b-4b0d-4d96-a181-2aaaae61f420'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:29 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:29 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:30 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e" returned: 0 in 0.434s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:30 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e Aug 26 03:01:30 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:30 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.402s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Deleted volume successfully. Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6573adc-134f-4315-910a-09f299a47e7d tempest-VolumesListTestJSON-1176648564 None] Lock "cinder-dff2fd2a-dc4d-49f1-aa91-c0c94f57ec61-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Acquiring lock "cinder-2a63b697-a4a4-4b25-809d-267f63cabb4a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Lock "cinder-2a63b697-a4a4-4b25-809d-267f63cabb4a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:30 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e.df713ac7-ad58-473c-a5c2-5dcf6f21075e" returned: 0 in 0.579s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Acquiring lock "cinder-quobyte-2a63b697-a4a4-4b25-809d-267f63cabb4a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Lock "cinder-quobyte-df713ac7-ad58-473c-a5c2-5dcf6f21075e" released by "_delete_snapshot" :: held 2.247s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Lock "cinder-quobyte-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" released by "delete_snapshot" :: held 2.335s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Lock "cinder-quobyte-2a63b697-a4a4-4b25-809d-267f63cabb4a" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[75506c9b-1d8f-483b-9395-1286d9e81256]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:30 devstack cinder-volume[93797]: WARNING cinder.quota [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-261366291 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-261366291, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:30 devstack cinder-volume[93797]: WARNING cinder.quota [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-261366291 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-261366291, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:30 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] Created reservations ['0fb5e424-4c29-4c92-80ab-83182fe1c9c1', 'fd133c1e-e462-4dfc-828c-a62805f009e2', 'd38fdf66-8784-4e2a-bbd1-536d73865461', '420659fd-8518-4506-b57c-806f9d98a972'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:30 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a Aug 26 03:01:30 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e629f728-249b-430b-b51d-dd4d030e499f tempest-GroupSnapshotsV319Test-1294855287 None] group_snapshot 25cb3b39-f0ff-441f-8de6-46bede5299b7: deleted successfully Aug 26 03:01:31 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a" returned: 0 in 0.459s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:31 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a Aug 26 03:01:31 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:31 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2a63b697-a4a4-4b25-809d-267f63cabb4a" returned: 0 in 0.285s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Lock "cinder-quobyte-2a63b697-a4a4-4b25-809d-267f63cabb4a" released by "delete_volume" :: held 0.793s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:31 devstack cinder-volume[93797]: WARNING cinder.quota [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1080427484 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1080427484, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:31 devstack cinder-volume[93797]: WARNING cinder.quota [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1080427484 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1080427484, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Created reservations ['3cf1ced8-01bd-4459-93f2-7982aacb5633', 'bc9c1950-0309-4ae3-8e12-55fd545be0b8', '6c26eedd-f54d-4c5e-9cf6-672c3ece90b2', 'e2b4dff7-913d-4fc9-8ec7-e7fefebeffca'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:31 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:31 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:32 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.535s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Deleted volume successfully. Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Acquiring lock "cinder-quobyte-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Lock "cinder-quobyte-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" acquired by "delete_volume" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0302c1a7-9c62-4341-ab75-22988b10f102 tempest-VolumeTypesAccessTest-1292736974 None] Lock "cinder-2a63b697-a4a4-4b25-809d-267f63cabb4a-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d225005c-3a3e-40bf-9c48-b5b7f8cf3735]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:32 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e Aug 26 03:01:32 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:32 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" returned: 0 in 0.477s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:32 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e Aug 26 03:01:32 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:33 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" returned: 0 in 0.299s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Lock "cinder-quobyte-c33926f5-be34-4d5b-a2af-ae80a0cbfd1e" released by "delete_volume" :: held 0.897s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Created reservations ['ea8d5726-c3e3-4300-9ac3-69b35f086dba'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:33 devstack cinder-volume[93797]: WARNING cinder.quota [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-261366291 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-261366291, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Created reservations ['e5c512c1-7c01-4e47-be95-056711510f6c', 'dc4b01d6-07e6-49bb-b503-4cc722148148', '3bc406f3-4585-4938-9a23-f298598b4704', '296e6236-4407-42a2-b102-cf24c6ca64cc'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:33 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:01:33 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:33 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.420s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:33 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0019545c-65ed-41d7-9877-7fd996945358 tempest-GroupSnapshotsV319Test-1294855287 None] Delete group completed successfully. Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=116,cinder:UPDATE=156,cinder:INSERT=35,cinder:DELETE=11 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Flow 'volume_create_manager' (12dcce6b-ce4a-46fd-be0e-c365121cb4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd76333-7159-47bc-82f7-56e06d6ffd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd76333-7159-47bc-82f7-56e06d6ffd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1024316275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb29a7c7-7757-4fd1-84ac-8a7bacf2007d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d66a27e9f447af9901dd640ac8beaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:35Z,use_quota=True,user_id='7871ed5a80bb4e058f44b64a1c30ee6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c10a42-eed2-4405-abe1-ee9ae6fc91aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c10a42-eed2-4405-abe1-ee9ae6fc91aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffa19a3-b820-48aa-bbfb-8da3e38ed071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffa19a3-b820-48aa-bbfb-8da3e38ed071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb29a7c7-7757-4fd1-84ac-8a7bacf2007d', 'volume_name': 'volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d084e7cb-5465-41fb-a99f-efaaec9d896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d084e7cb-5465-41fb-a99f-efaaec9d896d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9838bf6c-952c-4ced-9070-d144524fb203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Volume cb29a7c7-7757-4fd1-84ac-8a7bacf2007d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d', 'volume_size': 1} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1024316275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb29a7c7-7757-4fd1-84ac-8a7bacf2007d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d66a27e9f447af9901dd640ac8beaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:35Z,use_quota=True,user_id='7871ed5a80bb4e058f44b64a1c30ee6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Creating volume cb29a7c7-7757-4fd1-84ac-8a7bacf2007d {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:34 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:35 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d 1073741824 Aug 26 03:01:35 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:35 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d 1073741824" returned: 0 in 0.744s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:35 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=118,cinder:INSERT=40,cinder:UPDATE=173,cinder:DELETE=15 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:01:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:35 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d Aug 26 03:01:35 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:36 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d" returned: 0 in 0.368s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9838bf6c-952c-4ced-9070-d144524fb203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434d8e38-cb3f-48cb-866d-09e4b1b856b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:36 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Volume volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d (cb29a7c7-7757-4fd1-84ac-8a7bacf2007d): created successfully Aug 26 03:01:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434d8e38-cb3f-48cb-866d-09e4b1b856b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Flow 'volume_create_manager' (12dcce6b-ce4a-46fd-be0e-c365121cb4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b5572768-0fed-4d10-9c20-bc98bba59e41 tempest-VolumesNegativeTest-384157270 None] Created volume successfully. Aug 26 03:01:46 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:01:46 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:01:47 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Flow 'volume_create_manager' (decd28a5-8f9f-4a8d-b8e2-25628037559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd618566-58fc-4cd5-a68d-42612524beb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd618566-58fc-4cd5-a68d-42612524beb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1641669168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4228b67-378f-4a31-acd1-90093c20f7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c7dbdda4d5483ab3037364f54404f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:48Z,use_quota=True,user_id='a65780ee0d784de48f3adda2e854032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff926bc-9e7a-4a44-8f90-0efe90dd194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff926bc-9e7a-4a44-8f90-0efe90dd194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5ec14b-d0f4-4582-b17c-0baec9d1b05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5ec14b-d0f4-4582-b17c-0baec9d1b05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4228b67-378f-4a31-acd1-90093c20f7b1', 'volume_name': 'volume-f4228b67-378f-4a31-acd1-90093c20f7b1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf18eb0-7d4f-4765-8200-417e15bc5593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf18eb0-7d4f-4765-8200-417e15bc5593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea2f4e4-3468-4d7a-b2a6-98c846f80635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:48 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Volume f4228b67-378f-4a31-acd1-90093c20f7b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4228b67-378f-4a31-acd1-90093c20f7b1', 'volume_size': 1} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1641669168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4228b67-378f-4a31-acd1-90093c20f7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c7dbdda4d5483ab3037364f54404f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:48Z,use_quota=True,user_id='a65780ee0d784de48f3adda2e854032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Creating volume f4228b67-378f-4a31-acd1-90093c20f7b1 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:48 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:48 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 1073741824 Aug 26 03:01:48 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:48 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 1073741824" returned: 0 in 0.855s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:49 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 Aug 26 03:01:49 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:49 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1" returned: 0 in 0.352s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea2f4e4-3468-4d7a-b2a6-98c846f80635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4228b67-378f-4a31-acd1-90093c20f7b1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bef42e-c35e-49bc-8462-3e68f0a7e672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:49 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Volume volume-f4228b67-378f-4a31-acd1-90093c20f7b1 (f4228b67-378f-4a31-acd1-90093c20f7b1): created successfully Aug 26 03:01:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bef42e-c35e-49bc-8462-3e68f0a7e672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Flow 'volume_create_manager' (decd28a5-8f9f-4a8d-b8e2-25628037559f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-bb68017f-1ca9-4267-bfcf-8db6c6d55236 tempest-AttachVolumeNegativeTest-1289338477 None] Created volume successfully. Aug 26 03:01:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-a37529be-74f8-440a-a464-3184d5fa78a9 req-4f256d66-5f75-4909-8eaa-95d073bac458 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-a37529be-74f8-440a-a464-3184d5fa78a9 req-4f256d66-5f75-4909-8eaa-95d073bac458 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-a37529be-74f8-440a-a464-3184d5fa78a9 req-4f256d66-5f75-4909-8eaa-95d073bac458 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-a37529be-74f8-440a-a464-3184d5fa78a9 req-4f256d66-5f75-4909-8eaa-95d073bac458 tempest-AttachVolumeNegativeTest-1289338477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-f4228b67-378f-4a31-acd1-90093c20f7b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bca9647f-43ab-4005-bf78-59ba181d99c6', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:01:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-a37529be-74f8-440a-a464-3184d5fa78a9 req-4f256d66-5f75-4909-8eaa-95d073bac458 tempest-AttachVolumeNegativeTest-1289338477 None] attachment_update completed successfully. Aug 26 03:01:55 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-ab6d538f-794b-4a47-9a99-cf4d7feab4be req-9e279d15-878a-4800-abff-3036288f271e tempest-AttachVolumeNegativeTest-1289338477 None] Terminate volume connection completed successfully. Aug 26 03:01:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-ab6d538f-794b-4a47-9a99-cf4d7feab4be req-9e279d15-878a-4800-abff-3036288f271e tempest-AttachVolumeNegativeTest-1289338477 None] Deleting attachment bca9647f-43ab-4005-bf78-59ba181d99c6. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:02:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:02:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:02 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:02:02 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:02 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.471s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:02:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:02:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:02:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Acquiring lock "cinder-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Lock "cinder-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Acquiring lock "cinder-quobyte-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Lock "cinder-quobyte-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:05 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ef75ea-7161-4b53-a4d4-da3a1eae966b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:05 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d Aug 26 03:02:05 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:05 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d" returned: 0 in 0.476s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:05 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d Aug 26 03:02:05 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:05 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d" returned: 0 in 0.312s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Lock "cinder-quobyte-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d" released by "delete_volume" :: held 0.854s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:05 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Created reservations ['eaa966d7-0348-4e11-9bc7-6d6f64899489', 'b9bcfd1e-1b8e-462d-ae93-b3c9d03cd6b5', 'f6a53f5a-0742-4dfe-94a5-636289e178fe', '2d3747f2-f5dd-47df-95c7-9146b961c758'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:06 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:02:06 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:06 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Deleted volume successfully. Aug 26 03:02:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9176f4ee-f694-42da-a16d-e70d89d5aab1 tempest-VolumesNegativeTest-384157270 None] Lock "cinder-cb29a7c7-7757-4fd1-84ac-8a7bacf2007d-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:08 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Flow 'volume_create_manager' (12c3bed3-12b3-40bf-910f-59cbaefc0c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7d8d6f-ad3a-4da6-b402-a8dfe0272ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7d8d6f-ad3a-4da6-b402-a8dfe0272ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1500175246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26c4d9a-5230-48c9-809f-0d253e7dd856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224b523d6c60419c98b8c32f67f5275b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:09Z,use_quota=True,user_id='c04831f69dbc4058ba9cdf1f766f6810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a30d2716-2c57-427d-98af-db9150724e6a),volume_type_id=a30d2716-2c57-427d-98af-db9150724e6a)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245f4b1e-c2ef-4397-bb82-2fa16993de28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245f4b1e-c2ef-4397-bb82-2fa16993de28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ca03c4-02aa-4404-bcfc-f4f524647297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ca03c4-02aa-4404-bcfc-f4f524647297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26c4d9a-5230-48c9-809f-0d253e7dd856', 'volume_name': 'volume-e26c4d9a-5230-48c9-809f-0d253e7dd856', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a54e93-3a76-4e8a-a405-6de3100f95c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a54e93-3a76-4e8a-a405-6de3100f95c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298aba65-fc57-4206-8364-17c9a22140aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Volume e26c4d9a-5230-48c9-809f-0d253e7dd856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26c4d9a-5230-48c9-809f-0d253e7dd856', 'volume_size': 1} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1500175246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26c4d9a-5230-48c9-809f-0d253e7dd856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224b523d6c60419c98b8c32f67f5275b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:09Z,use_quota=True,user_id='c04831f69dbc4058ba9cdf1f766f6810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a30d2716-2c57-427d-98af-db9150724e6a),volume_type_id=a30d2716-2c57-427d-98af-db9150724e6a)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Creating volume e26c4d9a-5230-48c9-809f-0d253e7dd856 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:09 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:09 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 1073741824 Aug 26 03:02:09 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:09 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 1073741824" returned: 0 in 0.666s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:09 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 Aug 26 03:02:09 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:10 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856" returned: 0 in 0.365s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298aba65-fc57-4206-8364-17c9a22140aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26c4d9a-5230-48c9-809f-0d253e7dd856', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6521060-672e-4ebe-a05e-8fdabf1e88f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:10 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Volume volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 (e26c4d9a-5230-48c9-809f-0d253e7dd856): created successfully Aug 26 03:02:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6521060-672e-4ebe-a05e-8fdabf1e88f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Flow 'volume_create_manager' (12c3bed3-12b3-40bf-910f-59cbaefc0c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-42dcc1a3-7802-4285-889e-b75cbb29702c tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Created volume successfully. Aug 26 03:02:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:12 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:02:12 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:12 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.302s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:12 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:12 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-75225b55-3b32-41f8-8840-4f4cd96a78b2 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Retype volume completed successfully. Aug 26 03:02:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Acquiring lock "cinder-e26c4d9a-5230-48c9-809f-0d253e7dd856-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "cinder-e26c4d9a-5230-48c9-809f-0d253e7dd856-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Acquiring lock "cinder-quobyte-e26c4d9a-5230-48c9-809f-0d253e7dd856" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "cinder-quobyte-e26c4d9a-5230-48c9-809f-0d253e7dd856" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:13 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aed2c4-a6d9-43b6-bea0-6f186af49501]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:13 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 Aug 26 03:02:13 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:13 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856" returned: 0 in 0.441s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:13 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856 Aug 26 03:02:13 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:14 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e26c4d9a-5230-48c9-809f-0d253e7dd856" returned: 0 in 0.337s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "cinder-quobyte-e26c4d9a-5230-48c9-809f-0d253e7dd856" released by "delete_volume" :: held 0.831s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:14 devstack cinder-volume[93797]: WARNING cinder.quota [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:02:14 devstack cinder-volume[93797]: WARNING cinder.quota [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Created reservations ['e1f1918b-83a9-4bb5-9147-ca98e2c38146', '871cbb1b-45b9-4a1a-a081-baf6301f9e68', '5ce84d50-986a-4d35-9b08-7676ce14b387', '96417f7e-ac88-4948-a460-4706f6648856'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:14 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:02:14 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:14 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.338s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:14 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Deleted volume successfully. Aug 26 03:02:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0eccb612-8cb3-4132-82eb-ae4d2eac5475 tempest-VolumeRetypeWithoutMigrationTest-576330363 None] Lock "cinder-e26c4d9a-5230-48c9-809f-0d253e7dd856-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:24 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=31,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=3 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:02:24 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=31,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:02:33 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Flow 'volume_create_manager' (dadd6f99-e9f6-4180-821a-674c50740406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0944154b-0e07-4479-8e67-c2b774e3f7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0944154b-0e07-4479-8e67-c2b774e3f7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1110220761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65d2cebbc6a4e58a1dee715f6848890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:34Z,use_quota=True,user_id='68a219b6a98a43829aa95f7ff1fdd8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327c627c-54f6-4d49-b6f6-3ff870ad2f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327c627c-54f6-4d49-b6f6-3ff870ad2f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203c5a58-4a79-4fce-a720-2a75df696f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203c5a58-4a79-4fce-a720-2a75df696f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c', 'volume_name': 'volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202e2f61-d131-4d7f-8a7c-67abce7c5ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202e2f61-d131-4d7f-8a7c-67abce7c5ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a1767c-51b7-4259-b19b-91dd4d4ce4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Volume 9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c', 'volume_size': 1} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1110220761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65d2cebbc6a4e58a1dee715f6848890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:34Z,use_quota=True,user_id='68a219b6a98a43829aa95f7ff1fdd8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Creating volume 9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:34 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:34 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c 1073741824 Aug 26 03:02:34 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:34 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c 1073741824" returned: 0 in 0.730s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:35 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c Aug 26 03:02:35 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:35 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" returned: 0 in 0.484s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a1767c-51b7-4259-b19b-91dd4d4ce4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8733c9-bbec-466b-8305-ab54bcd9e94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:35 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Volume volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c (9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c): created successfully Aug 26 03:02:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8733c9-bbec-466b-8305-ab54bcd9e94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Flow 'volume_create_manager' (dadd6f99-e9f6-4180-821a-674c50740406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:35 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6f3adea6-f1b9-42ea-a781-029c489b86a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Created volume successfully. Aug 26 03:02:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Creating offline snapshot d162ac4c-0de2-43b6-8247-d5526614efdf of volume 9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:02:36 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[566ba6ee-cb10-45cd-b833-5b21ed014fd4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:36 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c Aug 26 03:02:36 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:37 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" returned: 0 in 0.663s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:37 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf 1G Aug 26 03:02:37 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:38 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf 1G" returned: 0 in 0.802s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:38 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf Aug 26 03:02:38 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:38 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf" returned: 0 in 0.623s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:38 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf is being set with open permissions: ugo+rw Aug 26 03:02:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:38 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf Aug 26 03:02:38 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:39 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf" returned: 0 in 0.386s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:39 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.info Aug 26 03:02:39 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:39 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.info" returned: 0 in 0.406s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:39 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.info is being set with open permissions: ugo+rw Aug 26 03:02:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:39 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.info Aug 26 03:02:39 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:40 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.info" returned: 0 in 0.439s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.487s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:40 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6887727a-d3b4-48cd-9e05-dff692110824 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Create snapshot completed successfully Aug 26 03:02:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "cinder-d162ac4c-0de2-43b6-8247-d5526614efdf-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-d162ac4c-0de2-43b6-8247-d5526614efdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.119s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "cinder-quobyte-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-quobyte-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "cinder-quobyte-d162ac4c-0de2-43b6-8247-d5526614efdf" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-quobyte-d162ac4c-0de2-43b6-8247-d5526614efdf" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Deleting offline snapshot d162ac4c-0de2-43b6-8247-d5526614efdf of volume 9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] snapshot_file for this snap is: volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec8515c-e7c3-473f-ae34-acfc939473e1]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:42 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf Aug 26 03:02:42 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:43 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf" returned: 0 in 1.080s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:02:43 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff061a00-8370-41c0-bf2c-57643600797f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:43 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c Aug 26 03:02:43 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:44 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" returned: 0 in 1.201s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:44 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf Aug 26 03:02:44 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:45 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf" returned: 0 in 1.007s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:45 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf Aug 26 03:02:45 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:46 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c.d162ac4c-0de2-43b6-8247-d5526614efdf" returned: 0 in 0.877s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-quobyte-d162ac4c-0de2-43b6-8247-d5526614efdf" released by "_delete_snapshot" :: held 4.478s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-quobyte-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" released by "delete_snapshot" :: held 4.530s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:46 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Created reservations ['2c31e21c-dd28-474a-9f38-e6f1062318ef', '8590cb60-0f51-4b61-b751-0f1f910d671b', 'a9ac3a50-0669-455d-9225-fdb131a2a496', '5d0ae343-7b8a-4418-bc44-24088c1a83f6'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:47 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Delete snapshot completed successfully. Aug 26 03:02:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-da709eb0-57f3-4f08-8025-5bbde2d0d097 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-d162ac4c-0de2-43b6-8247-d5526614efdf-delete_snapshot" released by "delete_snapshot" :: held 4.928s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "cinder-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "cinder-quobyte-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-quobyte-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:48 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a9dfc3-3024-4d9e-850d-a016df12f40b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:48 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c Aug 26 03:02:48 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:49 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" returned: 0 in 0.828s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:49 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c Aug 26 03:02:49 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:49 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" returned: 0 in 0.576s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-quobyte-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c" released by "delete_volume" :: held 1.569s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:49 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Created reservations ['39f265ba-8303-423b-90eb-b682df8f5b69', '53c2f680-0ae4-4f55-bcce-f717cd4be2df', 'a208b705-07db-4938-869c-7f14f734ed72', 'e625c5e8-d29c-4a1a-bf4b-aaeaa3998a77'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:50 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:02:50 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:50 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.396s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Deleted volume successfully. Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d76323a4-414a-48ed-a02b-96fbc444c877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1546058012 None] Lock "cinder-9cefc0c4-00eb-4a5f-bf6b-94a18f1b820c-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (702bbd03-4349-46c5-8242-df385fe5e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b762e5-528b-4010-83af-1a1647666296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b762e5-528b-4010-83af-1a1647666296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354289954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bec8a7-b9d1-4a62-a167-908f068b1d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:51Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fafb9b6-40cd-4f37-b941-8eb2f69f5b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fafb9b6-40cd-4f37-b941-8eb2f69f5b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5547f62-4c01-404c-a39f-c56db1505211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5547f62-4c01-404c-a39f-c56db1505211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bec8a7-b9d1-4a62-a167-908f068b1d44', 'volume_name': 'volume-16bec8a7-b9d1-4a62-a167-908f068b1d44', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25502485-7155-4be5-9283-d15cab21b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25502485-7155-4be5-9283-d15cab21b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc3116a-0a97-4b46-aecf-080c7d91def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Volume 16bec8a7-b9d1-4a62-a167-908f068b1d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bec8a7-b9d1-4a62-a167-908f068b1d44', 'volume_size': 1} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354289954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bec8a7-b9d1-4a62-a167-908f068b1d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:51Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Creating volume 16bec8a7-b9d1-4a62-a167-908f068b1d44 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:50 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:02:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:50 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 1073741824 Aug 26 03:02:50 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:51 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 1073741824" returned: 0 in 0.666s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:51 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 Aug 26 03:02:51 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:51 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44" returned: 0 in 0.344s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc3116a-0a97-4b46-aecf-080c7d91def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bec8a7-b9d1-4a62-a167-908f068b1d44', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8884086-b5d5-4de1-b8d9-f7885dc0a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:52 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Volume volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 (16bec8a7-b9d1-4a62-a167-908f068b1d44): created successfully Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8884086-b5d5-4de1-b8d9-f7885dc0a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (702bbd03-4349-46c5-8242-df385fe5e55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2da9ebfd-3df1-4639-a9d0-46201d48e01a tempest-VolumesActionsTest-103718105 None] Created volume successfully. Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc24a5b3-aa11-428d-a55e-f68202682ce6 tempest-VolumesActionsTest-103718105 None] Acquiring lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44" by "attach_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc24a5b3-aa11-428d-a55e-f68202682ce6 tempest-VolumesActionsTest-103718105 None] Lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44" acquired by "attach_volume" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-dc24a5b3-aa11-428d-a55e-f68202682ce6 tempest-VolumesActionsTest-103718105 None] Attaching volume 16bec8a7-b9d1-4a62-a167-908f068b1d44 to instance 0ec18925-522e-4c50-827c-cc4929b72bc3 at mountpoint /dev/vdb on host None. Aug 26 03:02:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-dc24a5b3-aa11-428d-a55e-f68202682ce6 tempest-VolumesActionsTest-103718105 None] Attach volume completed successfully. Aug 26 03:02:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc24a5b3-aa11-428d-a55e-f68202682ce6 tempest-VolumesActionsTest-103718105 None] Lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44" released by "attach_volume" :: held 0.143s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4082fcc4-1dda-4bdf-b16d-137a1ca4320b tempest-VolumesActionsTest-138690379 None] Terminate volume connection completed successfully. Aug 26 03:02:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4082fcc4-1dda-4bdf-b16d-137a1ca4320b tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-detach_volume" by "detach_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4082fcc4-1dda-4bdf-b16d-137a1ca4320b tempest-VolumesActionsTest-138690379 None] Lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4082fcc4-1dda-4bdf-b16d-137a1ca4320b tempest-VolumesActionsTest-138690379 None] Detaching volume 16bec8a7-b9d1-4a62-a167-908f068b1d44 from instance 0ec18925-522e-4c50-827c-cc4929b72bc3. Aug 26 03:02:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4082fcc4-1dda-4bdf-b16d-137a1ca4320b tempest-VolumesActionsTest-138690379 None] Detach volume completed successfully. Aug 26 03:02:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4082fcc4-1dda-4bdf-b16d-137a1ca4320b tempest-VolumesActionsTest-138690379 None] Lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6d1fcb73-2753-4785-8a7b-8ea35b76855b tempest-VolumesActionsTest-103718105 None] Acquiring lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-detach_volume" by "detach_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6d1fcb73-2753-4785-8a7b-8ea35b76855b tempest-VolumesActionsTest-103718105 None] Lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6d1fcb73-2753-4785-8a7b-8ea35b76855b tempest-VolumesActionsTest-103718105 None] Volume detach called, but volume not attached. Aug 26 03:02:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6d1fcb73-2753-4785-8a7b-8ea35b76855b tempest-VolumesActionsTest-103718105 None] Lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Acquiring lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Acquiring lock "cinder-quobyte-16bec8a7-b9d1-4a62-a167-908f068b1d44" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Lock "cinder-quobyte-16bec8a7-b9d1-4a62-a167-908f068b1d44" acquired by "delete_volume" :: waited 0.048s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[dced8dac-76c5-46fe-8d1d-bd29d86669f0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:55 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 Aug 26 03:02:55 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:55 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44" returned: 0 in 0.802s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:56 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44 Aug 26 03:02:56 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:56 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-16bec8a7-b9d1-4a62-a167-908f068b1d44" returned: 0 in 0.675s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Lock "cinder-quobyte-16bec8a7-b9d1-4a62-a167-908f068b1d44" released by "delete_volume" :: held 1.567s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Created reservations ['a123dabb-6de2-4f26-9804-80e10262e71c', '3bba21cf-ef04-4221-8d55-bf1234dbdf8f', 'f881e01e-63fa-4ae8-9cde-9887d865aa24', '63cfcdcd-aa38-4016-87e9-fdcdaceea289'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:57 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:02:57 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:57 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.554s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:57 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:57 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Deleted volume successfully. Aug 26 03:02:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-620254e2-34bb-47a0-9ba6-6ff1ce52098f tempest-VolumesActionsTest-103718105 None] Lock "cinder-16bec8a7-b9d1-4a62-a167-908f068b1d44-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:03:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:02 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:02 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:02 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.441s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Flow 'volume_create_manager' (8bd70dc8-15f9-4157-bd51-bb13d8ca132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3bdc96-4b3f-42c0-9b1e-9cb9c4d3b4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3bdc96-4b3f-42c0-9b1e-9cb9c4d3b4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-775716817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abddc02-b643-437e-b98a-a6fbcf1a3e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c7dbdda4d5483ab3037364f54404f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:02Z,use_quota=True,user_id='a65780ee0d784de48f3adda2e854032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb70098c-10bb-4533-9dc0-ac707968bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb70098c-10bb-4533-9dc0-ac707968bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc41b1f-4d19-4917-bb1d-2e29f1cd155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc41b1f-4d19-4917-bb1d-2e29f1cd155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abddc02-b643-437e-b98a-a6fbcf1a3e2d', 'volume_name': 'volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d7577e-dc86-44e5-a059-dd83d8544101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d7577e-dc86-44e5-a059-dd83d8544101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabd9118-ab05-472d-a5e3-e2be31863aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Volume 5abddc02-b643-437e-b98a-a6fbcf1a3e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d', 'volume_size': 1} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-775716817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abddc02-b643-437e-b98a-a6fbcf1a3e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c7dbdda4d5483ab3037364f54404f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:02Z,use_quota=True,user_id='a65780ee0d784de48f3adda2e854032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Creating volume 5abddc02-b643-437e-b98a-a6fbcf1a3e2d {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:02 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:02 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d 1073741824 Aug 26 03:03:02 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (f6c0d2d0-7214-4fdd-ac14-bbf18b0d5582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7323b87a-001f-4831-9637-4d62106b372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7323b87a-001f-4831-9637-4d62106b372b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1575042622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeca679d-a00e-43d3-9eff-25ab3fcec6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:03Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a466cc3-fa6e-4a49-accb-7fa40ae1fdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a466cc3-fa6e-4a49-accb-7fa40ae1fdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a079e-025d-4721-b86f-bd40edef6f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a079e-025d-4721-b86f-bd40edef6f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeca679d-a00e-43d3-9eff-25ab3fcec6da', 'volume_name': 'volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c351f67-8510-4d70-905b-77ca641586b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c351f67-8510-4d70-905b-77ca641586b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c89bfc-be6b-4144-b5d9-ca8e71e70425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:02 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Volume eeca679d-a00e-43d3-9eff-25ab3fcec6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da', 'volume_size': 1} Aug 26 03:03:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:03 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d 1073741824" returned: 0 in 0.987s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:03 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d Aug 26 03:03:03 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:04 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d" returned: 0 in 0.511s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1575042622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeca679d-a00e-43d3-9eff-25ab3fcec6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:03Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Creating volume eeca679d-a00e-43d3-9eff-25ab3fcec6da {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:04 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabd9118-ab05-472d-a5e3-e2be31863aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56972b18-1a98-472d-89a6-987587680e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:04 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Volume volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d (5abddc02-b643-437e-b98a-a6fbcf1a3e2d): created successfully Aug 26 03:03:04 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da 1073741824 Aug 26 03:03:04 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56972b18-1a98-472d-89a6-987587680e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Flow 'volume_create_manager' (8bd70dc8-15f9-4157-bd51-bb13d8ca132d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:04 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4c04d966-a7d7-49e0-b86b-b46071577b60 tempest-AttachVolumeNegativeTest-1289338477 None] Created volume successfully. Aug 26 03:03:05 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da 1073741824" returned: 0 in 0.957s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:05 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da Aug 26 03:03:05 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:05 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da" returned: 0 in 0.490s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c89bfc-be6b-4144-b5d9-ca8e71e70425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7472f536-7177-4db4-957e-eb4f0a3abd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:05 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Volume volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da (eeca679d-a00e-43d3-9eff-25ab3fcec6da): created successfully Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7472f536-7177-4db4-957e-eb4f0a3abd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (f6c0d2d0-7214-4fdd-ac14-bbf18b0d5582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:05 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5559a9be-5848-491d-a82a-ecb1130fa32f tempest-VolumesActionsTest-103718105 None] Created volume successfully. Aug 26 03:03:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8026c154-0a97-417e-80b5-ad9a25376bd0 req-40cccaee-d4ff-4ddb-90bf-df4f07a39384 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8026c154-0a97-417e-80b5-ad9a25376bd0 req-40cccaee-d4ff-4ddb-90bf-df4f07a39384 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8026c154-0a97-417e-80b5-ad9a25376bd0 req-40cccaee-d4ff-4ddb-90bf-df4f07a39384 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-8026c154-0a97-417e-80b5-ad9a25376bd0 req-40cccaee-d4ff-4ddb-90bf-df4f07a39384 tempest-AttachVolumeNegativeTest-1289338477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea5a959d-7a0c-441e-a821-6e9b75435cf1', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:03:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-8026c154-0a97-417e-80b5-ad9a25376bd0 req-40cccaee-d4ff-4ddb-90bf-df4f07a39384 tempest-AttachVolumeNegativeTest-1289338477 None] attachment_update completed successfully. Aug 26 03:03:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-eeca679d-a00e-43d3-9eff-25ab3fcec6da-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Lock "cinder-eeca679d-a00e-43d3-9eff-25ab3fcec6da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-quobyte-eeca679d-a00e-43d3-9eff-25ab3fcec6da" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Lock "cinder-quobyte-eeca679d-a00e-43d3-9eff-25ab3fcec6da" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:07 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e618234-fbb1-4868-9ca1-5dbd90d2f7c9]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:07 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da Aug 26 03:03:07 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:08 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da" returned: 0 in 0.700s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:08 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da Aug 26 03:03:08 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:08 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eeca679d-a00e-43d3-9eff-25ab3fcec6da" returned: 0 in 0.423s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Lock "cinder-quobyte-eeca679d-a00e-43d3-9eff-25ab3fcec6da" released by "delete_volume" :: held 1.193s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Created reservations ['3edc1988-67c9-402a-adad-070d6daf2113', 'b24f64b4-4796-4977-aa60-cd6e8ec2449b', '10d61111-2ca8-465c-9fae-8483692bac56', 'cbc82c27-a563-4e1a-96d3-b065e8d8bb25'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:08 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:08 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:09 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.495s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:09 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Deleted volume successfully. Aug 26 03:03:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-58202fac-2fb2-4bbe-958e-4592e0bac6cd tempest-VolumesActionsTest-138690379 None] Lock "cinder-eeca679d-a00e-43d3-9eff-25ab3fcec6da-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:10 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Flow 'volume_create_manager' (06d7f6e6-ab1e-49a2-a3ad-1c39622f5a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d916de-d784-4ca9-9912-00ca97a27c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d916de-d784-4ca9-9912-00ca97a27c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1150062631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd566c3e-20d0-4b80-bb43-e3777a2bee5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dd5c57b9064963b8792b51ff0b0fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:11Z,use_quota=True,user_id='58e3cf7d742849afbc6f0a625e3bdae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc03bc97-7f61-4c36-a8e8-1cb1a5f78288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc03bc97-7f61-4c36-a8e8-1cb1a5f78288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb3a8aa-6adc-4c2c-8668-f12ae415a25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb3a8aa-6adc-4c2c-8668-f12ae415a25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd566c3e-20d0-4b80-bb43-e3777a2bee5c', 'volume_name': 'volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8448ea-e8e0-4109-99be-d43d376552df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8448ea-e8e0-4109-99be-d43d376552df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fda337-b646-4c39-b8e2-c45924fe0f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Volume bd566c3e-20d0-4b80-bb43-e3777a2bee5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c', 'volume_size': 1} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1150062631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd566c3e-20d0-4b80-bb43-e3777a2bee5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dd5c57b9064963b8792b51ff0b0fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:11Z,use_quota=True,user_id='58e3cf7d742849afbc6f0a625e3bdae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Creating volume bd566c3e-20d0-4b80-bb43-e3777a2bee5c {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:11 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:11 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c 1073741824 Aug 26 03:03:11 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-247d7e0b-f8e9-4309-89df-f28cd9dce625 req-21010167-629c-484f-b043-7d96309de97c tempest-AttachVolumeNegativeTest-1289338477 None] Terminate volume connection completed successfully. Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-247d7e0b-f8e9-4309-89df-f28cd9dce625 req-21010167-629c-484f-b043-7d96309de97c tempest-AttachVolumeNegativeTest-1289338477 None] Deleting attachment ea5a959d-7a0c-441e-a821-6e9b75435cf1. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (f2994670-a63f-41c7-8a86-e6fc21b0530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bfc5f8-10c3-4fc0-9cea-e6e54b28ef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bfc5f8-10c3-4fc0-9cea-e6e54b28ef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-967246128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315e307b-f20a-4ebf-8742-81fa5e24dbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:11Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43303de6-f7d3-429c-8307-5a39c88918b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43303de6-f7d3-429c-8307-5a39c88918b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175a38e2-648e-4bb7-ac73-d5eaadb98df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175a38e2-648e-4bb7-ac73-d5eaadb98df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315e307b-f20a-4ebf-8742-81fa5e24dbb5', 'volume_name': 'volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0e62a2-3e6e-4fa0-a45e-ec5583d7fdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0e62a2-3e6e-4fa0-a45e-ec5583d7fdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ddefdb-15ba-4bb8-b04a-1b03baf68581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Volume 315e307b-f20a-4ebf-8742-81fa5e24dbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5', 'volume_size': 1} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Flow 'volume_create_manager' (07ef9ed7-2960-4415-b1ef-92738fa6d8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c559a2c-2f4f-4687-8c04-47ff4e688e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c559a2c-2f4f-4687-8c04-47ff4e688e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1271583896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48db432d-1df0-4d86-9b31-b4fca061a675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a003af8ad814b9faa1c28433441cd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:12Z,use_quota=True,user_id='0c600a2a36b04e268f746151b167d18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d067086-200b-42af-976a-578b6c0ef141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d067086-200b-42af-976a-578b6c0ef141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1e237f-6473-4c6a-b26c-2091c24cc60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1e237f-6473-4c6a-b26c-2091c24cc60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48db432d-1df0-4d86-9b31-b4fca061a675', 'volume_name': 'volume-48db432d-1df0-4d86-9b31-b4fca061a675', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f597f237-c1c0-4527-9236-d8ebcbe0d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f597f237-c1c0-4527-9236-d8ebcbe0d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8f5f0e-a5fd-4a3b-af5c-d0c3eecbd7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:11 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Volume 48db432d-1df0-4d86-9b31-b4fca061a675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48db432d-1df0-4d86-9b31-b4fca061a675', 'volume_size': 1} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:11 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c 1073741824" returned: 0 in 0.698s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:11 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c Aug 26 03:03:11 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:12 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c" returned: 0 in 0.305s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-967246128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315e307b-f20a-4ebf-8742-81fa5e24dbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:11Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Creating volume 315e307b-f20a-4ebf-8742-81fa5e24dbb5 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:12 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fda337-b646-4c39-b8e2-c45924fe0f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5cb812-578e-4415-b522-a6ad1042d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:12 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 1073741824 Aug 26 03:03:12 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:12 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Volume volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c (bd566c3e-20d0-4b80-bb43-e3777a2bee5c): created successfully Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5cb812-578e-4415-b522-a6ad1042d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Flow 'volume_create_manager' (06d7f6e6-ab1e-49a2-a3ad-1c39622f5a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:12 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-275fc7c0-1c7f-4c0a-be4c-d36f79ba295e tempest-TestMinimumBasicScenario-1447587931 None] Created volume successfully. Aug 26 03:03:13 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 1073741824" returned: 0 in 0.876s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:13 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 Aug 26 03:03:13 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:13 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5" returned: 0 in 0.551s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.924s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1271583896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48db432d-1df0-4d86-9b31-b4fca061a675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a003af8ad814b9faa1c28433441cd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:12Z,use_quota=True,user_id='0c600a2a36b04e268f746151b167d18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Creating volume 48db432d-1df0-4d86-9b31-b4fca061a675 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:13 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ddefdb-15ba-4bb8-b04a-1b03baf68581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6163ef-26f9-40c1-80c9-7dc54bb13ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:13 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 1073741824 Aug 26 03:03:13 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Volume volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 (315e307b-f20a-4ebf-8742-81fa5e24dbb5): created successfully Aug 26 03:03:13 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6163ef-26f9-40c1-80c9-7dc54bb13ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (f2994670-a63f-41c7-8a86-e6fc21b0530b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a4edf677-9788-400c-a621-359b5a64eced tempest-VolumesActionsTest-103718105 None] Created volume successfully. Aug 26 03:03:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-315e307b-f20a-4ebf-8742-81fa5e24dbb5-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Lock "cinder-315e307b-f20a-4ebf-8742-81fa5e24dbb5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-quobyte-315e307b-f20a-4ebf-8742-81fa5e24dbb5" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Lock "cinder-quobyte-315e307b-f20a-4ebf-8742-81fa5e24dbb5" acquired by "delete_volume" :: waited 0.040s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:14 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:14 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a455c-361f-48eb-bafd-dec2f846cf86]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 1073741824" returned: 0 in 0.963s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:14 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 Aug 26 03:03:14 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:15 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 Aug 26 03:03:15 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:15 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675" returned: 0 in 0.667s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8f5f0e-a5fd-4a3b-af5c-d0c3eecbd7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48db432d-1df0-4d86-9b31-b4fca061a675', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a097304-2cdd-4379-a7be-1f5424f09054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Volume volume-48db432d-1df0-4d86-9b31-b4fca061a675 (48db432d-1df0-4d86-9b31-b4fca061a675): created successfully Aug 26 03:03:15 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a097304-2cdd-4379-a7be-1f5424f09054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Flow 'volume_create_manager' (07ef9ed7-2960-4415-b1ef-92738fa6d8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5" returned: 0 in 0.913s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4a22fe44-e60d-42d1-9767-492adeb2e7ee tempest-VolumesListAdminTestJSON-1347589258 None] Created volume successfully. Aug 26 03:03:15 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5 Aug 26 03:03:15 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-e1858055-55a5-43d2-8b6b-1c81af9aad1c req-dbdafa9a-fad8-4c31-982b-884857545dd8 tempest-TestMinimumBasicScenario-1447587931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-e1858055-55a5-43d2-8b6b-1c81af9aad1c req-dbdafa9a-fad8-4c31-982b-884857545dd8 tempest-TestMinimumBasicScenario-1447587931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-e1858055-55a5-43d2-8b6b-1c81af9aad1c req-dbdafa9a-fad8-4c31-982b-884857545dd8 tempest-TestMinimumBasicScenario-1447587931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-e1858055-55a5-43d2-8b6b-1c81af9aad1c req-dbdafa9a-fad8-4c31-982b-884857545dd8 tempest-TestMinimumBasicScenario-1447587931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6dad28c-72db-460c-964d-3b7b7f359174', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:03:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-e1858055-55a5-43d2-8b6b-1c81af9aad1c req-dbdafa9a-fad8-4c31-982b-884857545dd8 tempest-TestMinimumBasicScenario-1447587931 None] attachment_update completed successfully. Aug 26 03:03:16 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315e307b-f20a-4ebf-8742-81fa5e24dbb5" returned: 0 in 0.414s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Lock "cinder-quobyte-315e307b-f20a-4ebf-8742-81fa5e24dbb5" released by "delete_volume" :: held 1.426s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Created reservations ['4e7dfb84-90b8-4915-91cf-811630f76a91', '84ecdc86-01b3-42e8-8074-b976a4283149', '4c9f8c39-a9b8-4254-8e32-d509b54a57ef', '167c822d-5ca4-469f-9c98-6d9e69ec152d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:16 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:16 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:17 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.641s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Deleted volume successfully. Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7a10e2-4911-4bb5-b12a-5ef97d0f9783 tempest-VolumesActionsTest-138690379 None] Lock "cinder-315e307b-f20a-4ebf-8742-81fa5e24dbb5-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Flow 'volume_create_manager' (1b65096a-8d7c-4df1-9dd6-74a9bc60b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e98c511-0313-4b19-9d36-1ff31daf461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e98c511-0313-4b19-9d36-1ff31daf461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-323629795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d6011e-1712-4a33-bca3-2ffe555a5606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a003af8ad814b9faa1c28433441cd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:18Z,use_quota=True,user_id='0c600a2a36b04e268f746151b167d18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abadbe42-2c23-4018-bf18-1c2aba9e05ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abadbe42-2c23-4018-bf18-1c2aba9e05ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9a158b-06dc-4071-8ede-d49837aa80fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9a158b-06dc-4071-8ede-d49837aa80fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d6011e-1712-4a33-bca3-2ffe555a5606', 'volume_name': 'volume-f9d6011e-1712-4a33-bca3-2ffe555a5606', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed75f61b-0862-4466-8aa6-d55fc2990d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed75f61b-0862-4466-8aa6-d55fc2990d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2dfe59-95ba-4838-842f-2f0b226e463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Volume f9d6011e-1712-4a33-bca3-2ffe555a5606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d6011e-1712-4a33-bca3-2ffe555a5606', 'volume_size': 1} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-323629795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d6011e-1712-4a33-bca3-2ffe555a5606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a003af8ad814b9faa1c28433441cd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:18Z,use_quota=True,user_id='0c600a2a36b04e268f746151b167d18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Creating volume f9d6011e-1712-4a33-bca3-2ffe555a5606 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:17 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:17 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 1073741824 Aug 26 03:03:17 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (0b3d2440-c9dc-43a4-af81-bef58ebe9775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e77625-3793-4c0e-9c50-6b5c4531cb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e77625-3793-4c0e-9c50-6b5c4531cb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-888824138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d612ee-046f-4335-8754-8086066f41bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:18Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26be15dc-6d56-4f4d-b270-e2ab60d8cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26be15dc-6d56-4f4d-b270-e2ab60d8cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c28685b-ff67-4ca6-9149-1485fff31fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c28685b-ff67-4ca6-9149-1485fff31fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d612ee-046f-4335-8754-8086066f41bc', 'volume_name': 'volume-95d612ee-046f-4335-8754-8086066f41bc', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e252e7d-6762-4558-ac5d-ce3050144895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e252e7d-6762-4558-ac5d-ce3050144895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8161cd-b964-4907-95de-87fe61c027ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:18 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Volume 95d612ee-046f-4335-8754-8086066f41bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d612ee-046f-4335-8754-8086066f41bc', 'volume_size': 1} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:18 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 1073741824" returned: 0 in 0.734s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:18 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 Aug 26 03:03:18 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:18 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606" returned: 0 in 0.312s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-888824138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d612ee-046f-4335-8754-8086066f41bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:18Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Creating volume 95d612ee-046f-4335-8754-8086066f41bc {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:18 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2dfe59-95ba-4838-842f-2f0b226e463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d6011e-1712-4a33-bca3-2ffe555a5606', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f763c9e-02d5-4532-8c31-6115181a4590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:19 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc 1073741824 Aug 26 03:03:19 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:19 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Volume volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 (f9d6011e-1712-4a33-bca3-2ffe555a5606): created successfully Aug 26 03:03:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f763c9e-02d5-4532-8c31-6115181a4590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Flow 'volume_create_manager' (1b65096a-8d7c-4df1-9dd6-74a9bc60b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-94cd2597-86e3-4768-ae43-8760b1c23899 tempest-VolumesListAdminTestJSON-1347589258 None] Created volume successfully. Aug 26 03:03:19 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc 1073741824" returned: 0 in 0.959s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:20 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc Aug 26 03:03:20 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:20 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc" returned: 0 in 0.654s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8161cd-b964-4907-95de-87fe61c027ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d612ee-046f-4335-8754-8086066f41bc', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63972e2b-9821-4a74-8777-3e7df37e8d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:20 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Volume volume-95d612ee-046f-4335-8754-8086066f41bc (95d612ee-046f-4335-8754-8086066f41bc): created successfully Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63972e2b-9821-4a74-8777-3e7df37e8d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (0b3d2440-c9dc-43a4-af81-bef58ebe9775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-45ef800a-2d47-40dd-83b6-87c77bf1d79e tempest-VolumesActionsTest-103718105 None] Created volume successfully. Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Flow 'volume_create_manager' (dc4e019e-6b74-40da-b9b8-e6b69a825409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb2ad8f-b290-4046-9dab-c1126acddee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb2ad8f-b290-4046-9dab-c1126acddee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1615674923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b07f9b-fbe6-467d-973c-45f273269267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a003af8ad814b9faa1c28433441cd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:21Z,use_quota=True,user_id='0c600a2a36b04e268f746151b167d18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c292d6-bd0c-4016-b397-eb453942a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c292d6-bd0c-4016-b397-eb453942a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcef038a-6bee-467b-b1ec-91f22c11d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcef038a-6bee-467b-b1ec-91f22c11d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b07f9b-fbe6-467d-973c-45f273269267', 'volume_name': 'volume-b3b07f9b-fbe6-467d-973c-45f273269267', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498094f4-0eea-41a0-8314-2645c6042018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498094f4-0eea-41a0-8314-2645c6042018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d122090-075e-4d73-8a3f-91cd01ab873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:21 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Volume b3b07f9b-fbe6-467d-973c-45f273269267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b07f9b-fbe6-467d-973c-45f273269267', 'volume_size': 1} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1615674923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b07f9b-fbe6-467d-973c-45f273269267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a003af8ad814b9faa1c28433441cd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:21Z,use_quota=True,user_id='0c600a2a36b04e268f746151b167d18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Creating volume b3b07f9b-fbe6-467d-973c-45f273269267 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:21 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "cinder-5abddc02-b643-437e-b98a-a6fbcf1a3e2d-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:21 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 1073741824 Aug 26 03:03:21 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-5abddc02-b643-437e-b98a-a6fbcf1a3e2d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "cinder-quobyte-5abddc02-b643-437e-b98a-a6fbcf1a3e2d" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-quobyte-5abddc02-b643-437e-b98a-a6fbcf1a3e2d" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90831c0-7d02-4d81-8224-721077b1ff4b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:21 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d Aug 26 03:03:21 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-95d612ee-046f-4335-8754-8086066f41bc-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Lock "cinder-95d612ee-046f-4335-8754-8086066f41bc-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-quobyte-95d612ee-046f-4335-8754-8086066f41bc" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:21 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Lock "cinder-quobyte-95d612ee-046f-4335-8754-8086066f41bc" acquired by "delete_volume" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 1073741824" returned: 0 in 0.890s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d623089f-ad87-405d-b8bd-27a415b6e6eb]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:22 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 Aug 26 03:03:22 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:22 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d" returned: 0 in 0.802s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:22 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc Aug 26 03:03:22 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:22 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d Aug 26 03:03:22 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:22 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267" returned: 0 in 0.357s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d122090-075e-4d73-8a3f-91cd01ab873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b07f9b-fbe6-467d-973c-45f273269267', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7746f5a7-4f83-41cd-a3b1-3264fd609bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:22 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Volume volume-b3b07f9b-fbe6-467d-973c-45f273269267 (b3b07f9b-fbe6-467d-973c-45f273269267): created successfully Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7746f5a7-4f83-41cd-a3b1-3264fd609bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Flow 'volume_create_manager' (dc4e019e-6b74-40da-b9b8-e6b69a825409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:22 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:22 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-de6d4083-dbcc-4f7c-88c2-5a962615cc03 tempest-VolumesListAdminTestJSON-1347589258 None] Created volume successfully. Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5abddc02-b643-437e-b98a-a6fbcf1a3e2d" returned: 0 in 0.365s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-quobyte-5abddc02-b643-437e-b98a-a6fbcf1a3e2d" released by "delete_volume" :: held 1.243s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:22 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc" returned: 0 in 0.532s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:22 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc Aug 26 03:03:22 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Created reservations ['1aed2e81-bade-4568-bb12-2c630842ad64', '0074bd20-1faa-4db2-89ce-a4327c05e675', 'ebb7a53f-0915-4e07-bd15-4e5e771c4c62', '619c249b-7abb-451d-98dd-1d18412b40bd'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:22 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:22 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:22 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-95d612ee-046f-4335-8754-8086066f41bc" returned: 0 in 0.311s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Lock "cinder-quobyte-95d612ee-046f-4335-8754-8086066f41bc" released by "delete_volume" :: held 0.911s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Created reservations ['2e78fb12-5d42-41c9-8bc9-48c44d086c20', 'd9ad150c-9be9-48d8-ab74-1e49243182a1', 'a4b8ed48-3433-4e74-80e8-00c59e3cc9d8', '3048af6c-0fbb-4cd1-8ef2-f3f28205e82f'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:22 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.326s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:22 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:22 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Deleted volume successfully. Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8c85cfe-0c21-415f-8102-0a48f43d4cdb tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-5abddc02-b643-437e-b98a-a6fbcf1a3e2d-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:23 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:23 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:23 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.375s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:23 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Deleted volume successfully. Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82392fbf-f8f5-447f-a9aa-b00024846504 tempest-VolumesActionsTest-138690379 None] Lock "cinder-95d612ee-046f-4335-8754-8086066f41bc-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "cinder-f4228b67-378f-4a31-acd1-90093c20f7b1-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-f4228b67-378f-4a31-acd1-90093c20f7b1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "cinder-quobyte-f4228b67-378f-4a31-acd1-90093c20f7b1" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-quobyte-f4228b67-378f-4a31-acd1-90093c20f7b1" acquired by "delete_volume" :: waited 0.058s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[126f2be9-29c8-4b5f-8c5e-6a9f013d5139]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (421a47f4-bff0-4002-9d2c-3186514f1ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d286bbf-a46f-4359-9214-423368c72523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Flow 'volume_create_manager' (5ef77708-bd71-42ff-8b01-9ce9f2ebe0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66384522-fec8-49e6-b92e-9b71b03b25c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d286bbf-a46f-4359-9214-423368c72523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-679052333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cd7f4d-f694-4664-ab1a-caf47aca8815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:24Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5842f47-3354-425c-a0f9-a1baacb39adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5842f47-3354-425c-a0f9-a1baacb39adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 Aug 26 03:03:24 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e7d74d-bd92-4578-af4b-7b940cafe850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e7d74d-bd92-4578-af4b-7b940cafe850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cd7f4d-f694-4664-ab1a-caf47aca8815', 'volume_name': 'volume-00cd7f4d-f694-4664-ab1a-caf47aca8815', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd71d79-e540-48bf-a9b3-870c50c301fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd71d79-e540-48bf-a9b3-870c50c301fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df2cade-a4d4-4cdf-97ce-05ea50cbbb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Volume 00cd7f4d-f694-4664-ab1a-caf47aca8815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cd7f4d-f694-4664-ab1a-caf47aca8815', 'volume_size': 1} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-679052333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cd7f4d-f694-4664-ab1a-caf47aca8815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:24Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Creating volume 00cd7f4d-f694-4664-ab1a-caf47aca8815 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:24 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66384522-fec8-49e6-b92e-9b71b03b25c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5297f7b-1798-4102-942f-6d8c46d90df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7918fb555542482db62b22200e3ded16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:24Z,use_quota=True,user_id='361cfe5c9e454836a45033010bbd3c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 1073741824 Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab7d61a-7db7-412e-981a-42bd8ea60fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab7d61a-7db7-412e-981a-42bd8ea60fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ecc99d-c38e-48ff-8547-12fab5799b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ecc99d-c38e-48ff-8547-12fab5799b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5297f7b-1798-4102-942f-6d8c46d90df9', 'volume_name': 'volume-c5297f7b-1798-4102-942f-6d8c46d90df9', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8763357f-823a-4339-aaca-a2e40139364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8763357f-823a-4339-aaca-a2e40139364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624237dd-3dd3-4610-8746-c051f45932ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Volume c5297f7b-1798-4102-942f-6d8c46d90df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5297f7b-1798-4102-942f-6d8c46d90df9', 'volume_size': 1} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:24 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1" returned: 0 in 0.560s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:24 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1 Aug 26 03:03:24 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:25 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f4228b67-378f-4a31-acd1-90093c20f7b1" returned: 0 in 0.361s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:25 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 1073741824" returned: 0 in 0.722s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-quobyte-f4228b67-378f-4a31-acd1-90093c20f7b1" released by "delete_volume" :: held 1.017s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=80,cinder:INSERT=17,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=90,cinder:SELECT=89,cinder:DELETE=9,cinder:INSERT=24 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:25 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 Aug 26 03:03:25 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Created reservations ['2f9dd9fd-6206-4af8-8e3b-19fe75435dc0', '413d0b8b-d718-4690-980f-674b0df0fabc', '45fea221-01f2-4033-a143-74bdef118133', '824c794f-0a67-4ea7-94c7-3b577d162728'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:25 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:25 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:25 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815" returned: 0 in 0.342s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5297f7b-1798-4102-942f-6d8c46d90df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7918fb555542482db62b22200e3ded16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:24Z,use_quota=True,user_id='361cfe5c9e454836a45033010bbd3c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Creating volume c5297f7b-1798-4102-942f-6d8c46d90df9 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:25 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df2cade-a4d4-4cdf-97ce-05ea50cbbb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cd7f4d-f694-4664-ab1a-caf47aca8815', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:25 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 1073741824 Aug 26 03:03:25 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2708ade-ccbf-4054-bf34-850a0904c0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:25 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Volume volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 (00cd7f4d-f694-4664-ab1a-caf47aca8815): created successfully Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2708ade-ccbf-4054-bf34-850a0904c0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (421a47f4-bff0-4002-9d2c-3186514f1ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:25 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-21549738-47d6-4e59-9200-977af7cafeae tempest-VolumesActionsTest-103718105 None] Created volume successfully. Aug 26 03:03:25 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.341s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:25 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Deleted volume successfully. Aug 26 03:03:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cffbeb74-3690-460b-ae8b-e2aeedde93d6 tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-f4228b67-378f-4a31-acd1-90093c20f7b1-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:26 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 1073741824" returned: 0 in 0.742s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-00cd7f4d-f694-4664-ab1a-caf47aca8815-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Lock "cinder-00cd7f4d-f694-4664-ab1a-caf47aca8815-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:26 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 Aug 26 03:03:26 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Acquiring lock "cinder-quobyte-00cd7f4d-f694-4664-ab1a-caf47aca8815" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Lock "cinder-quobyte-00cd7f4d-f694-4664-ab1a-caf47aca8815" acquired by "delete_volume" :: waited 0.032s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe0c8e6-2fd4-4539-a088-8ee5dc53604d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "cinder-e9769958-2964-4380-bc59-46f258543a0d-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:26 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 Aug 26 03:03:26 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-e9769958-2964-4380-bc59-46f258543a0d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "cinder-quobyte-e9769958-2964-4380-bc59-46f258543a0d" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-quobyte-e9769958-2964-4380-bc59-46f258543a0d" acquired by "delete_volume" :: waited 0.053s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[7697bef6-0dfa-4fda-a521-9a29dd4f293f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:26 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9" returned: 0 in 0.540s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624237dd-3dd3-4610-8746-c051f45932ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5297f7b-1798-4102-942f-6d8c46d90df9', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4690e7-d8e7-42cd-9f06-947064b723ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:27 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Volume volume-c5297f7b-1798-4102-942f-6d8c46d90df9 (c5297f7b-1798-4102-942f-6d8c46d90df9): created successfully Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4690e7-d8e7-42cd-9f06-947064b723ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Flow 'volume_create_manager' (5ef77708-bd71-42ff-8b01-9ce9f2ebe0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:27 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-99f0aade-0f1c-41e6-86dc-ba17cafd7d2e tempest-VolumesListAdminTestJSON-896831785 None] Created volume successfully. Aug 26 03:03:27 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d Aug 26 03:03:27 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:27 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815" returned: 0 in 0.601s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:27 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815 Aug 26 03:03:27 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:27 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d" returned: 0 in 0.588s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:27 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-00cd7f4d-f694-4664-ab1a-caf47aca8815" returned: 0 in 0.358s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:27 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d Aug 26 03:03:27 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Lock "cinder-quobyte-00cd7f4d-f694-4664-ab1a-caf47aca8815" released by "delete_volume" :: held 1.050s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Created reservations ['4914f14c-28db-4b7c-af0f-5899ea9937e1', '2b31c4f3-e0d8-452b-b65c-badd217a8497', 'ad5bd701-3727-494c-9fdc-83bfc2eec40e', '47863483-a85a-4bdf-9e20-16d5b3732edb'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:27 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:27 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:27 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e9769958-2964-4380-bc59-46f258543a0d" returned: 0 in 0.308s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-quobyte-e9769958-2964-4380-bc59-46f258543a0d" released by "delete_volume" :: held 0.964s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:27 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Created reservations ['fa2c0636-9b21-4277-912c-05a924004e17', '66818745-db50-409a-927b-54003a8e951a', 'c67c987d-107c-40fb-8ea7-27dc1c7540a7', 'cb0860f8-703b-4495-8995-e1f9a9a4e005'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:28 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:28 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:28 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.362s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Deleted volume successfully. Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d1d1c7bf-1277-47a8-95ac-192296b632fc tempest-VolumesActionsTest-138690379 None] Lock "cinder-00cd7f4d-f694-4664-ab1a-caf47aca8815-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:28 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.445s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Deleted volume successfully. Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Acquiring lock "cinder-c5297f7b-1798-4102-942f-6d8c46d90df9-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6e2c8d69-218f-484d-8af7-a029f95ed58b tempest-AttachVolumeNegativeTest-1289338477 None] Lock "cinder-e9769958-2964-4380-bc59-46f258543a0d-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Lock "cinder-c5297f7b-1798-4102-942f-6d8c46d90df9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Acquiring lock "cinder-quobyte-c5297f7b-1798-4102-942f-6d8c46d90df9" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Lock "cinder-quobyte-c5297f7b-1798-4102-942f-6d8c46d90df9" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[245714fa-82e4-4aab-84ce-6fbf035a338d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "cinder-b3b07f9b-fbe6-467d-973c-45f273269267-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-b3b07f9b-fbe6-467d-973c-45f273269267-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:29 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 Aug 26 03:03:29 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "cinder-quobyte-b3b07f9b-fbe6-467d-973c-45f273269267" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-quobyte-b3b07f9b-fbe6-467d-973c-45f273269267" acquired by "delete_volume" :: waited 0.045s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:29 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d98f98-ee35-4332-b696-f8be7778850a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:29 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9" returned: 0 in 0.724s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:29 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 Aug 26 03:03:29 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:29 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9 Aug 26 03:03:29 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:30 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c5297f7b-1798-4102-942f-6d8c46d90df9" returned: 0 in 0.633s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:30 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Lock "cinder-quobyte-c5297f7b-1798-4102-942f-6d8c46d90df9" released by "delete_volume" :: held 1.463s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267" returned: 0 in 0.902s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:30 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267 Aug 26 03:03:30 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (6bec5588-be8a-4ecb-a3e9-03791861476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f821514d-d4b1-42b9-92fc-54704cb8094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f821514d-d4b1-42b9-92fc-54704cb8094b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-190195858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2b9114-3ccd-4dd0-9470-2d87ce1220b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:30Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca63aae-825f-4cb7-a6c3-4a036798d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca63aae-825f-4cb7-a6c3-4a036798d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf410aa-f1f2-463e-9ffa-42a7cad96b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf410aa-f1f2-463e-9ffa-42a7cad96b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2b9114-3ccd-4dd0-9470-2d87ce1220b5', 'volume_name': 'volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566c65b3-26f6-494a-b848-19156e85d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566c65b3-26f6-494a-b848-19156e85d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c673b3a4-35b9-41dd-9bcc-2e041e21650e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Volume 7e2b9114-3ccd-4dd0-9470-2d87ce1220b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5', 'volume_size': 1} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-190195858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2b9114-3ccd-4dd0-9470-2d87ce1220b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9575a77890964cecb92da09c0ddce15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:30Z,use_quota=True,user_id='ee56fe9874f14fafae2bebfb092320ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Creating volume 7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:30 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:30 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 1073741824 Aug 26 03:03:30 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Created reservations ['07712a4a-57da-4a1e-80d0-21c5c7f7ee5f', 'f0f8f98d-8599-4bbb-a3eb-342f352fa6a6', 'dfa78744-6654-4529-a84c-82a72f28ae07', '66c05d1c-cddc-4f83-af4b-dd8f7ac2a885'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:30 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3b07f9b-fbe6-467d-973c-45f273269267" returned: 0 in 0.629s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:30 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:30 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-quobyte-b3b07f9b-fbe6-467d-973c-45f273269267" released by "delete_volume" :: held 1.682s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:30 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Created reservations ['970ba7c5-45cd-48af-a1ff-fad27e31ec2e', '4dcc2c05-10dd-4206-95c4-dc84a04a0db5', '60fda1bf-6b1c-49a7-a4f5-4ec0c0e4b781', 'c3579543-a083-4781-88a1-b1b7a53a7c04'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:31 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:31 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:31 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.490s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Deleted volume successfully. Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e435d64a-84f8-4b78-ac07-7d1ade997405 tempest-VolumesListAdminTestJSON-896831785 None] Lock "cinder-c5297f7b-1798-4102-942f-6d8c46d90df9-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:31 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 1073741824" returned: 0 in 1.064s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:31 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 Aug 26 03:03:31 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:31 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.567s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Deleted volume successfully. Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4fdb84e-c69d-4bcf-afbc-63e15110bf1c tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-b3b07f9b-fbe6-467d-973c-45f273269267-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "cinder-f9d6011e-1712-4a33-bca3-2ffe555a5606-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-f9d6011e-1712-4a33-bca3-2ffe555a5606-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "cinder-quobyte-f9d6011e-1712-4a33-bca3-2ffe555a5606" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-quobyte-f9d6011e-1712-4a33-bca3-2ffe555a5606" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:31 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118c6bf-6512-417e-99fb-e898ccf062ae]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:32 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5" returned: 0 in 0.417s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c673b3a4-35b9-41dd-9bcc-2e041e21650e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5523bd25-2803-4d4e-abfa-671d96d6ca62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:32 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Volume volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 (7e2b9114-3ccd-4dd0-9470-2d87ce1220b5): created successfully Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5523bd25-2803-4d4e-abfa-671d96d6ca62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Flow 'volume_create_manager' (6bec5588-be8a-4ecb-a3e9-03791861476d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e86dcce7-f357-4a1c-9e2d-1c81599dbed3 tempest-VolumesActionsTest-103718105 None] Created volume successfully. Aug 26 03:03:32 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 Aug 26 03:03:32 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:32 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606" returned: 0 in 0.610s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:32 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606 Aug 26 03:03:32 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:33 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f9d6011e-1712-4a33-bca3-2ffe555a5606" returned: 0 in 0.466s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-quobyte-f9d6011e-1712-4a33-bca3-2ffe555a5606" released by "delete_volume" :: held 1.141s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Created reservations ['1ee71779-e7fb-4c05-9a9e-29ed743bd216', 'c28ff2db-7775-4315-bed7-8c10140f47bd', 'ec53319c-eb82-4488-a07b-1604aa165b48', '717d0ff8-cbcf-4a8f-b461-2be4c69c55d2'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Acquiring lock "cinder-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Lock "cinder-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:33 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:33 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Acquiring lock "cinder-quobyte-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Lock "cinder-quobyte-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[68696f47-d741-471a-af88-7424c6e6bb3d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:33 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 Aug 26 03:03:33 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:33 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.469s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Deleted volume successfully. Aug 26 03:03:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-911d1a7f-d5e2-4e81-a647-a695c1fddca4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-f9d6011e-1712-4a33-bca3-2ffe555a5606-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:34 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5" returned: 0 in 0.532s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:34 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5 Aug 26 03:03:34 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "cinder-48db432d-1df0-4d86-9b31-b4fca061a675-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:34 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-48db432d-1df0-4d86-9b31-b4fca061a675-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5" returned: 0 in 0.375s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Lock "cinder-quobyte-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5" released by "delete_volume" :: held 0.981s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "cinder-quobyte-48db432d-1df0-4d86-9b31-b4fca061a675" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-quobyte-48db432d-1df0-4d86-9b31-b4fca061a675" acquired by "delete_volume" :: waited 0.058s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fcb1af-3ef7-4433-baf6-35cd3aa0a377]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Created reservations ['a2205398-06cb-404d-9a22-8caca0ecb6fc', '185a5754-a61c-40e3-8497-be3046b70bdf', '66888423-7ea6-4f60-b56a-6c2206eb41ca', 'cca0f83f-1260-47b1-a033-1523f86578a9'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:34 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 Aug 26 03:03:34 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:34 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:34 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:35 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675" returned: 0 in 0.469s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:35 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.294s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:35 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675 Aug 26 03:03:35 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:35 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Deleted volume successfully. Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9d673bde-bf15-4eaa-9ac8-acfd3163a0a3 tempest-VolumesActionsTest-103718105 None] Lock "cinder-7e2b9114-3ccd-4dd0-9470-2d87ce1220b5-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:35 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-48db432d-1df0-4d86-9b31-b4fca061a675" returned: 0 in 0.302s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-quobyte-48db432d-1df0-4d86-9b31-b4fca061a675" released by "delete_volume" :: held 0.841s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Created reservations ['85d6e814-3999-4273-ad0f-39f3524463ce', 'dbe7defc-50de-48ee-b721-e88c03361f62', '44279a05-f7b5-438a-b27b-1890dd8c4826', '384f4b64-1ed9-4979-a449-74579d51a1b8'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:35 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:35 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:36 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.381s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:36 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Deleted volume successfully. Aug 26 03:03:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dcac29f6-3707-4496-a876-36a8af9091d4 tempest-VolumesListAdminTestJSON-1347589258 None] Lock "cinder-48db432d-1df0-4d86-9b31-b4fca061a675-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Flow 'volume_create_manager' (0aa73b73-2e9a-40af-a2c1-2c992255c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a43387-19af-45bd-bf77-a52ac4974c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a43387-19af-45bd-bf77-a52ac4974c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-296288287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a8dcac4a5947d39f1f8d8d4dcdcec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:45Z,use_quota=True,user_id='a459a6611e924f3bab6efe85e315ac1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22daf48-be3a-4e2d-a227-8b6c5d2c1ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22daf48-be3a-4e2d-a227-8b6c5d2c1ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93822279-7a78-4924-8d4a-706df0783479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93822279-7a78-4924-8d4a-706df0783479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3', 'volume_name': 'volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72687fe0-7ae5-4681-9a8a-2e109886aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72687fe0-7ae5-4681-9a8a-2e109886aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17781ad5-90dc-47dc-8f82-e816012b824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Volume b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3', 'volume_size': 1} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-296288287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a8dcac4a5947d39f1f8d8d4dcdcec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:45Z,use_quota=True,user_id='a459a6611e924f3bab6efe85e315ac1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Creating volume b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:45 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:45 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 1073741824 Aug 26 03:03:45 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Flow 'volume_create_manager' (d4fa4db0-5224-46f9-b726-41b356315607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a679b1ef-0ba4-4be5-9f31-c536ce1bd001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a679b1ef-0ba4-4be5-9f31-c536ce1bd001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1438213733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03984ddc-cbd7-4fad-975b-03acf30adca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3d8bc1fa3f47e7b67b7e82e60ccf70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:45Z,use_quota=True,user_id='f5d9026582674356be9e7257d6ae2c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dfe243-f5f8-4440-8039-f507f60f6755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dfe243-f5f8-4440-8039-f507f60f6755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ac1bae-44ff-49ee-a09f-38b43170abf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ac1bae-44ff-49ee-a09f-38b43170abf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03984ddc-cbd7-4fad-975b-03acf30adca2', 'volume_name': 'volume-03984ddc-cbd7-4fad-975b-03acf30adca2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54d0614-84f4-4fe2-9954-802a2341e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54d0614-84f4-4fe2-9954-802a2341e0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75408973-2b70-4e2f-bb29-290fc382f5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:45 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Volume 03984ddc-cbd7-4fad-975b-03acf30adca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03984ddc-cbd7-4fad-975b-03acf30adca2', 'volume_size': 1} Aug 26 03:03:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:46 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 1073741824" returned: 0 in 0.636s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:46 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 Aug 26 03:03:46 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:46 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" returned: 0 in 0.307s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1438213733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03984ddc-cbd7-4fad-975b-03acf30adca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3d8bc1fa3f47e7b67b7e82e60ccf70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:45Z,use_quota=True,user_id='f5d9026582674356be9e7257d6ae2c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Creating volume 03984ddc-cbd7-4fad-975b-03acf30adca2 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:46 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17781ad5-90dc-47dc-8f82-e816012b824a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eeebb94-90a6-4fd5-89cf-46d7991f89d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:46 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 1073741824 Aug 26 03:03:46 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:46 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Volume volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 (b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3): created successfully Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eeebb94-90a6-4fd5-89cf-46d7991f89d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Flow 'volume_create_manager' (0aa73b73-2e9a-40af-a2c1-2c992255c73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-7b9c1837-d988-4bd4-a7be-bcd68a12698e req-2498da26-9561-4158-878d-4146f47be1be tempest-VolumesSnapshotsTestJSON-498283235 None] Created volume successfully. Aug 26 03:03:47 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 1073741824" returned: 0 in 0.654s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:47 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 Aug 26 03:03:47 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:47 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2" returned: 0 in 0.360s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75408973-2b70-4e2f-bb29-290fc382f5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03984ddc-cbd7-4fad-975b-03acf30adca2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5b7315-62e3-4251-bf85-a5d107d3487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Volume volume-03984ddc-cbd7-4fad-975b-03acf30adca2 (03984ddc-cbd7-4fad-975b-03acf30adca2): created successfully Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5b7315-62e3-4251-bf85-a5d107d3487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Flow 'volume_create_manager' (d4fa4db0-5224-46f9-b726-41b356315607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:47 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-506bdc14-fa27-4b42-b76a-ec1c6c2a21ea tempest-SnapshotMetadataTestJSON-725728288 None] Created volume successfully. Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Creating offline snapshot 2761c85f-8ad9-4a6a-a767-c32966bc987f of volume b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[93263d46-4fd2-4c19-abb9-456158461f04]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:48 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 Aug 26 03:03:48 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:48 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" returned: 0 in 0.584s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:48 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f 1G Aug 26 03:03:48 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:49 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f 1G" returned: 0 in 0.550s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:49 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f Aug 26 03:03:49 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:49 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f" returned: 0 in 0.451s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:49 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f is being set with open permissions: ugo+rw Aug 26 03:03:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:49 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f Aug 26 03:03:49 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:49 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f" returned: 0 in 0.327s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:49 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.info Aug 26 03:03:49 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:50 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.info" returned: 0 in 0.360s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:50 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.info is being set with open permissions: ugo+rw Aug 26 03:03:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:50 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.info Aug 26 03:03:50 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:50 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.info" returned: 0 in 0.373s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.982s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Creating offline snapshot 5366b23d-c578-4883-94d1-4c4f63f8e1c1 of volume 03984ddc-cbd7-4fad-975b-03acf30adca2 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:03:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-68cd8d64-1dc2-45df-bc63-e2a9847d3f7f req-b5f1a4a9-aec3-470f-a2ae-dba30cd2e385 tempest-VolumesSnapshotsTestJSON-498283235 None] Create snapshot completed successfully Aug 26 03:03:50 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c77150-5626-4c19-80a1-9f7bdb881f96]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:50 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 Aug 26 03:03:50 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:51 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2" returned: 0 in 0.443s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:51 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 1G Aug 26 03:03:51 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:51 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "cinder-2761c85f-8ad9-4a6a-a767-c32966bc987f-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 1G" returned: 0 in 0.602s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03984ddc-cbd7-4fad-975b-03acf30adca2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-2761c85f-8ad9-4a6a-a767-c32966bc987f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "cinder-quobyte-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:51 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03984ddc-cbd7-4fad-975b-03acf30adca2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 Aug 26 03:03:51 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-quobyte-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "cinder-quobyte-2761c85f-8ad9-4a6a-a767-c32966bc987f" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-quobyte-2761c85f-8ad9-4a6a-a767-c32966bc987f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Deleting offline snapshot 2761c85f-8ad9-4a6a-a767-c32966bc987f of volume b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] snapshot_file for this snap is: volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d724dfe-f66c-43c9-aa8c-a4a69f9376c7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:52 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f Aug 26 03:03:52 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:52 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03984ddc-cbd7-4fad-975b-03acf30adca2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1" returned: 0 in 0.412s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:52 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 is being set with open permissions: ugo+rw Aug 26 03:03:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:52 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 Aug 26 03:03:52 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:52 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f" returned: 0 in 0.564s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:03:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f716a6-3d7e-425b-86dc-501c0e7d9e25]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:52 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1" returned: 0 in 0.428s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:52 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 Aug 26 03:03:52 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:52 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.info Aug 26 03:03:52 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:53 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" returned: 0 in 0.554s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:53 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f Aug 26 03:03:53 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:53 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.info" returned: 0 in 0.552s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:53 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.info is being set with open permissions: ugo+rw Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:53 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.info Aug 26 03:03:53 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:53 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f" returned: 0 in 0.394s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:53 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f Aug 26 03:03:53 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:53 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.info" returned: 0 in 0.388s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a631c6a5-4a50-48f9-9a13-55f631871288 tempest-SnapshotMetadataTestJSON-725728288 None] Create snapshot completed successfully Aug 26 03:03:53 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3.2761c85f-8ad9-4a6a-a767-c32966bc987f" returned: 0 in 0.345s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-quobyte-2761c85f-8ad9-4a6a-a767-c32966bc987f" released by "_delete_snapshot" :: held 2.048s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-quobyte-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" released by "delete_snapshot" :: held 2.096s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:54 devstack cinder-volume[93797]: DEBUG cinder.quota [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Created reservations ['e1720743-234e-4f0e-b983-ea1fc363d2c9', 'ad15b7d3-6181-4c17-b66f-f3a1c2287e9a', '7f496ad7-2c96-4f53-8536-9f8215b33361', '8ebd8b1f-1155-46b2-ba2a-0f1a774f3732'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Delete snapshot completed successfully. Aug 26 03:03:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-7aefb3f4-c6df-4c86-a35c-164cd18f51db req-65e640c0-d321-4c1a-959d-3df18ed6d16a tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-2761c85f-8ad9-4a6a-a767-c32966bc987f-delete_snapshot" released by "delete_snapshot" :: held 2.425s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "cinder-5366b23d-c578-4883-94d1-4c4f63f8e1c1-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-5366b23d-c578-4883-94d1-4c4f63f8e1c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "cinder-quobyte-03984ddc-cbd7-4fad-975b-03acf30adca2" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-quobyte-03984ddc-cbd7-4fad-975b-03acf30adca2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "cinder-quobyte-5366b23d-c578-4883-94d1-4c4f63f8e1c1" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-quobyte-5366b23d-c578-4883-94d1-4c4f63f8e1c1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Deleting offline snapshot 5366b23d-c578-4883-94d1-4c4f63f8e1c1 of volume 03984ddc-cbd7-4fad-975b-03acf30adca2 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] snapshot_file for this snap is: volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e849ef-8843-4ab1-b154-7d6e9a983092]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Flow 'volume_create_manager' (c10895f0-5076-469a-812f-75d44b047f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95345e30-dd47-46e3-af67-f63ea7d3f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95345e30-dd47-46e3-af67-f63ea7d3f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-523692894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746067f1-a86e-41c4-850e-73bdbfc55bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8292a0ec763d434ba175f348baf13122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:55Z,use_quota=True,user_id='c7526d0aab9743129d3344ce21d7c58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3382bc-9314-4ac3-aa53-e5dd8fc47496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3382bc-9314-4ac3-aa53-e5dd8fc47496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a72ed5-6493-45f6-ab73-1c8a042011d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a72ed5-6493-45f6-ab73-1c8a042011d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746067f1-a86e-41c4-850e-73bdbfc55bbc', 'volume_name': 'volume-746067f1-a86e-41c4-850e-73bdbfc55bbc', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d628c7c-5c88-4269-b7d5-5d64833a5869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d628c7c-5c88-4269-b7d5-5d64833a5869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf50e5b-fd43-4dc1-b985-c5cf2d5aa919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:55 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Volume 746067f1-a86e-41c4-850e-73bdbfc55bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746067f1-a86e-41c4-850e-73bdbfc55bbc', 'volume_size': 1} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-523692894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746067f1-a86e-41c4-850e-73bdbfc55bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8292a0ec763d434ba175f348baf13122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:55Z,use_quota=True,user_id='c7526d0aab9743129d3344ce21d7c58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Creating volume 746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:55 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 Aug 26 03:03:55 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:55 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:55 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc 1073741824 Aug 26 03:03:55 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "cinder-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "cinder-quobyte-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-quobyte-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:55 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1" returned: 0 in 0.463s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03984ddc-cbd7-4fad-975b-03acf30adca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a883a9-7f8e-44bd-8fd7-b0a1249d2e0d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f6e9d7-bb9c-43e3-a1d2-1b6ef2a96fb7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:55 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 Aug 26 03:03:55 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:55 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 Aug 26 03:03:55 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:55 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc 1073741824" returned: 0 in 0.537s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:55 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc Aug 26 03:03:55 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:55 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" returned: 0 in 0.439s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:56 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:56 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3 Aug 26 03:03:56 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2" returned: 0 in 0.466s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:56 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 Aug 26 03:03:56 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:56 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc" returned: 0 in 0.331s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf50e5b-fd43-4dc1-b985-c5cf2d5aa919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746067f1-a86e-41c4-850e-73bdbfc55bbc', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d37ce1-221d-4fdb-b6cd-4d258fcd6f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:56 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Volume volume-746067f1-a86e-41c4-850e-73bdbfc55bbc (746067f1-a86e-41c4-850e-73bdbfc55bbc): created successfully Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d37ce1-221d-4fdb-b6cd-4d258fcd6f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Flow 'volume_create_manager' (c10895f0-5076-469a-812f-75d44b047f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5ff57a14-a878-4ff1-9aff-50358759b070 tempest-VolumesDeleteCascade-1984299369 None] Created volume successfully. Aug 26 03:03:56 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" returned: 0 in 0.272s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-quobyte-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3" released by "delete_volume" :: held 0.818s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:56 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.quota [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Created reservations ['77b5c5fd-be92-4d21-8143-6bcf5cd2e3f5', 'd401318c-46dd-4735-8167-1d811791e8db', '535e3b4b-4133-4528-835b-4975575ca80a', '1ae3478c-8289-4349-8c85-6196da31a728'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1" returned: 0 in 0.407s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:56 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1 Aug 26 03:03:56 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:56 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:56 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:56 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2.5366b23d-c578-4883-94d1-4c4f63f8e1c1" returned: 0 in 0.306s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-quobyte-5366b23d-c578-4883-94d1-4c4f63f8e1c1" released by "_delete_snapshot" :: held 1.785s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-quobyte-03984ddc-cbd7-4fad-975b-03acf30adca2" released by "delete_snapshot" :: held 1.814s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:56 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.314s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.manager [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Deleted volume successfully. Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-8390d934-a76f-4bdd-83da-5a7036feae7d req-f9b5e93b-15d6-4b9d-a523-af6ebcabd6a7 tempest-VolumesSnapshotsTestJSON-498283235 None] Lock "cinder-b4d4413f-5e9b-48f2-9e78-c9f8c4a347a3-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Created reservations ['3a67f200-7a77-4d8d-ae13-dca7f87b70d2', 'e59f4e2b-2409-4407-bc6e-fb84bbb76602', 'b779d937-66af-46f9-be24-7724c0c39d00', 'f2914928-4b49-4e18-a460-57966a883feb'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Delete snapshot completed successfully. Aug 26 03:03:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0d7bdb18-d6f7-42f4-a693-d4eae20f31e0 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-5366b23d-c578-4883-94d1-4c4f63f8e1c1-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "cinder-03984ddc-cbd7-4fad-975b-03acf30adca2-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-03984ddc-cbd7-4fad-975b-03acf30adca2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "cinder-quobyte-03984ddc-cbd7-4fad-975b-03acf30adca2" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-quobyte-03984ddc-cbd7-4fad-975b-03acf30adca2" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[806d1e9b-27d3-4f42-a523-451db57b8206]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Creating offline snapshot 0235a47a-523e-4724-ad6f-407e0ad29fad of volume 746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a5d43-8b9b-4299-ad36-fd4ec6d8a93f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:57 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 Aug 26 03:03:57 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:57 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc Aug 26 03:03:57 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:57 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2" returned: 0 in 0.454s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:57 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2 Aug 26 03:03:57 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:57 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc" returned: 0 in 0.415s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:57 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad 1G Aug 26 03:03:57 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:58 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03984ddc-cbd7-4fad-975b-03acf30adca2" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-quobyte-03984ddc-cbd7-4fad-975b-03acf30adca2" released by "delete_volume" :: held 0.857s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Created reservations ['e4ca79ca-41f1-4099-9904-0c3857cc83be', '56f34a50-2132-4e59-b6a4-089e3fbab8a7', '7093c735-4c41-4fda-ae29-7280b20529c3', 'f4a8a354-4d92-4e05-abf7-5e5d0a51eecb'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:58 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:03:58 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:58 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad 1G" returned: 0 in 0.642s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:58 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad Aug 26 03:03:58 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:58 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.342s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Deleted volume successfully. Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec83b21-ae28-4504-8be0-d11a0978db53 tempest-SnapshotMetadataTestJSON-725728288 None] Lock "cinder-03984ddc-cbd7-4fad-975b-03acf30adca2-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:58 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad" returned: 0 in 0.390s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:58 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad is being set with open permissions: ugo+rw Aug 26 03:03:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:59 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad Aug 26 03:03:59 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:59 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad" returned: 0 in 0.352s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:59 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.info Aug 26 03:03:59 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:59 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.info" returned: 0 in 0.324s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:59 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.info is being set with open permissions: ugo+rw Aug 26 03:03:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:59 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.info Aug 26 03:03:59 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:59 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.info" returned: 0 in 0.272s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.512s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-fa60c1fa-3b6a-4f82-a1bf-561110fa3080 tempest-VolumesDeleteCascade-1984299369 None] Create snapshot completed successfully Aug 26 03:04:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Creating offline snapshot 3ea543ca-ea38-4377-8a09-f85d942b62d6 of volume 746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:04:00 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc20d2b-e4f6-4fa6-bb4e-c22e6baabecd]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:01 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad Aug 26 03:04:01 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:01 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad" returned: 0 in 0.649s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-746067f1-a86e-41c4-850e-73bdbfc55bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:01 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 1G Aug 26 03:04:01 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:02 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:02 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:02 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.385s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:04:02 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 1G" returned: 0 in 0.854s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:02 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 Aug 26 03:04:02 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:02 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6" returned: 0 in 0.413s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:02 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 is being set with open permissions: ugo+rw Aug 26 03:04:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:02 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 Aug 26 03:04:02 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:03 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.344s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-570142b5-c8f5-4f9f-ab60-a583fc85ac38 tempest-VolumesDeleteCascade-1984299369 None] Create snapshot completed successfully Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-746067f1-a86e-41c4-850e-73bdbfc55bbc-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-746067f1-a86e-41c4-850e-73bdbfc55bbc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Performing cascade delete. {{(pid=93797) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-0235a47a-523e-4724-ad6f-407e0ad29fad-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-0235a47a-523e-4724-ad6f-407e0ad29fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-0235a47a-523e-4724-ad6f-407e0ad29fad" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-0235a47a-523e-4724-ad6f-407e0ad29fad" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Deleting offline snapshot 0235a47a-523e-4724-ad6f-407e0ad29fad of volume 746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] snapshot_file for this snap is: volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb329799-d763-45c4-a8ab-9fcfde129d2c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:04 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad Aug 26 03:04:04 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:05 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad" returned: 0 in 0.568s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-746067f1-a86e-41c4-850e-73bdbfc55bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:05 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46dcbd5-662b-464b-970e-6f507cbc90c4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:05 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc Aug 26 03:04:05 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:05 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc" returned: 0 in 0.618s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:05 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[242922c4-2d08-4149-b35d-c686d0805ecf]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:06 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 Aug 26 03:04:06 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:06 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6" returned: 0 in 0.798s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-746067f1-a86e-41c4-850e-73bdbfc55bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:06 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5978f82-8ddd-45e7-9ac2-6bf7f1d7fad9]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:06 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad Aug 26 03:04:06 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:07 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad" returned: 0 in 0.551s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-746067f1-a86e-41c4-850e-73bdbfc55bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:07 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfcf19d-17b8-4f6e-b4d3-8d94288df466]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:07 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc Aug 26 03:04:07 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:07 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc" returned: 0 in 0.616s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:07 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad Aug 26 03:04:07 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:08 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bd221157-5738-43c2-b10b-c967fb3b328a tempest-BackendsCapabilitiesAdminTestsJSON-1558082790 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.883586883545, 'free_capacity_gb': 1774.883586883545, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93797) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 03:04:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad" returned: 0 in 0.610s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:08 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad Aug 26 03:04:08 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20eccfc1-6c9f-4c1a-a540-e5de46a528ba tempest-BackendsCapabilitiesAdminTestsJSON-1558082790 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.883586883545, 'free_capacity_gb': 1774.883586883545, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93797) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 03:04:09 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Flow 'volume_create_manager' (b9160e83-f718-443a-8601-11ed9e467a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ee8426-4d42-4203-9695-84e7929eeefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.0235a47a-523e-4724-ad6f-407e0ad29fad" returned: 0 in 0.724s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 -F qcow2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ee8426-4d42-4203-9695-84e7929eeefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1099449326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7381aa2a-8084-4e33-a1ec-37a62b35d5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa325fc7510445569b7dbdaa6e7d4953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:09Z,use_quota=True,user_id='e3050568616c4d1098ba69e729a28194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ccd835-ffc0-4f84-8a31-9ed8344e0869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:09 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 -F qcow2 Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ccd835-ffc0-4f84-8a31-9ed8344e0869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:09 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c85cc8d-5808-4175-8b34-ae231abbb1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c85cc8d-5808-4175-8b34-ae231abbb1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7381aa2a-8084-4e33-a1ec-37a62b35d5de', 'volume_name': 'volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc749be-93f7-4b7d-a7ae-11388a88736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc749be-93f7-4b7d-a7ae-11388a88736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de4f251-8957-45d9-af22-661f2f40759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Volume 7381aa2a-8084-4e33-a1ec-37a62b35d5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de', 'volume_size': 1} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1099449326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7381aa2a-8084-4e33-a1ec-37a62b35d5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa325fc7510445569b7dbdaa6e7d4953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:09Z,use_quota=True,user_id='e3050568616c4d1098ba69e729a28194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Creating volume 7381aa2a-8084-4e33-a1ec-37a62b35d5de {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:09 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:09 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de 1073741824 Aug 26 03:04:09 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-ac4713db-48d4-4c32-ab7c-ee90f5056dae req-2e36aa93-d4a0-440c-aebb-d0ab34ea4268 tempest-TestMinimumBasicScenario-1447587931 None] Terminate volume connection completed successfully. Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-ac4713db-48d4-4c32-ab7c-ee90f5056dae req-2e36aa93-d4a0-440c-aebb-d0ab34ea4268 tempest-TestMinimumBasicScenario-1447587931 None] Deleting attachment b6dad28c-72db-460c-964d-3b7b7f359174. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:04:09 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746067f1-a86e-41c4-850e-73bdbfc55bbc /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 -F qcow2" returned: 0 in 0.520s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-0235a47a-523e-4724-ad6f-407e0ad29fad" released by "_delete_snapshot" :: held 5.297s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" released by "delete_snapshot" :: held 5.338s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Created reservations ['fb4c41f0-b3b1-4252-8c7d-fe324bf1ae6c', '84f1f12f-71c9-43f1-b099-0c95215c4609', 'ace7ea4e-3b4b-411e-a346-9b510cd69600', 'ccdf8a7e-6f47-4f32-a960-6f003bb7843a'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Delete snapshot completed successfully. Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-0235a47a-523e-4724-ad6f-407e0ad29fad-delete_snapshot" released by "delete_snapshot" :: held 5.621s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-3ea543ca-ea38-4377-8a09-f85d942b62d6-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:09 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de 1073741824" returned: 0 in 0.720s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-3ea543ca-ea38-4377-8a09-f85d942b62d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:10 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-3ea543ca-ea38-4377-8a09-f85d942b62d6" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:10 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-3ea543ca-ea38-4377-8a09-f85d942b62d6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Deleting offline snapshot 3ea543ca-ea38-4377-8a09-f85d942b62d6 of volume 746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] snapshot_file for this snap is: volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81ce629-2c3b-4173-bb0a-f155002d7dd5]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:10 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 Aug 26 03:04:10 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:10 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de4f251-8957-45d9-af22-661f2f40759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5acc2485-e416-44b5-86c3-67b636c5abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:10 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Volume volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de (7381aa2a-8084-4e33-a1ec-37a62b35d5de): created successfully Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5acc2485-e416-44b5-86c3-67b636c5abda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Flow 'volume_create_manager' (b9160e83-f718-443a-8601-11ed9e467a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-237bccb2-7b8a-442a-8a09-0daf5b271b2b tempest-AbsoluteLimitsTests-953895841 None] Created volume successfully. Aug 26 03:04:10 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6" returned: 0 in 0.433s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-746067f1-a86e-41c4-850e-73bdbfc55bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f564d1ab-5f74-49a7-86e8-82005dd730f4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:10 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc Aug 26 03:04:10 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Acquiring lock "cinder-bd566c3e-20d0-4b80-bb43-e3777a2bee5c-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:11 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc" returned: 0 in 0.545s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Lock "cinder-bd566c3e-20d0-4b80-bb43-e3777a2bee5c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:11 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 Aug 26 03:04:11 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Acquiring lock "cinder-quobyte-bd566c3e-20d0-4b80-bb43-e3777a2bee5c" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Lock "cinder-quobyte-bd566c3e-20d0-4b80-bb43-e3777a2bee5c" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9c498-76af-406a-9732-1651de682135]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Acquiring lock "cinder-7381aa2a-8084-4e33-a1ec-37a62b35d5de-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Lock "cinder-7381aa2a-8084-4e33-a1ec-37a62b35d5de-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Acquiring lock "cinder-quobyte-7381aa2a-8084-4e33-a1ec-37a62b35d5de" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:11 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c Aug 26 03:04:11 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Lock "cinder-quobyte-7381aa2a-8084-4e33-a1ec-37a62b35d5de" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[296b8da8-8ce7-41cc-ad01-4a64b102f575]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:11 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6" returned: 0 in 0.542s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:11 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6 Aug 26 03:04:11 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:11 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de Aug 26 03:04:11 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:11 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c" returned: 0 in 0.565s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:11 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c Aug 26 03:04:11 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:12 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc.3ea543ca-ea38-4377-8a09-f85d942b62d6" returned: 0 in 0.373s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:12 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de" returned: 0 in 0.521s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-3ea543ca-ea38-4377-8a09-f85d942b62d6" released by "_delete_snapshot" :: held 2.063s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" released by "delete_snapshot" :: held 2.101s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:12 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de Aug 26 03:04:12 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Created reservations ['bfec6e96-f31d-441b-9814-181e8797df69', '75ad7592-7913-4a71-9f03-52dc2f09490a', 'd0fa359f-6b6b-46d5-b0c0-428b8e24704e', 'd1e80862-0f62-47c9-84bc-de86f0ac8f63'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:12 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd566c3e-20d0-4b80-bb43-e3777a2bee5c" returned: 0 in 0.410s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Lock "cinder-quobyte-bd566c3e-20d0-4b80-bb43-e3777a2bee5c" released by "delete_volume" :: held 1.059s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:12 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Delete snapshot completed successfully. Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-3ea543ca-ea38-4377-8a09-f85d942b62d6-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Snapshots deleted, issuing volume delete {{(pid=93797) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Created reservations ['dbdb77ad-5ece-41cd-b89c-21c80aef3396', '887dc60a-4384-46f2-8317-781f81a52f2a', '8ebbf7ce-08a1-4275-854c-440e6c3008a3', '7329fb6a-71ca-495e-b072-7e925848388e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:12 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[66679762-35da-4676-abd6-264258e47e56]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7381aa2a-8084-4e33-a1ec-37a62b35d5de" returned: 0 in 0.412s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Lock "cinder-quobyte-7381aa2a-8084-4e33-a1ec-37a62b35d5de" released by "delete_volume" :: held 1.005s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Created reservations ['17a6b50c-2789-4050-819e-96074bc19955', 'fa3fc53f-a092-4446-ae72-1ee84c15e7d6', 'd3d54bbf-4bcb-4d22-ad0e-8293e0965675', '7f9d1710-89e9-4dd1-a344-2176443b0c52'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:12 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc Aug 26 03:04:12 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:12 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:12 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:12 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:12 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:13 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc" returned: 0 in 0.504s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:13 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc Aug 26 03:04:13 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:13 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.368s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Deleted volume successfully. Aug 26 03:04:13 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.323s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Deleted volume successfully. Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b4356910-d67a-4969-879c-acabdf98b766 tempest-TestMinimumBasicScenario-1447587931 None] Lock "cinder-bd566c3e-20d0-4b80-bb43-e3777a2bee5c-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-36a06c77-7c57-4afd-b968-77dfbb5554ba tempest-AbsoluteLimitsTests-953895841 None] Lock "cinder-7381aa2a-8084-4e33-a1ec-37a62b35d5de-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:13 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-746067f1-a86e-41c4-850e-73bdbfc55bbc" returned: 0 in 0.335s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-746067f1-a86e-41c4-850e-73bdbfc55bbc" released by "delete_volume" :: held 0.922s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Created reservations ['74fb7dde-f219-48c6-a25f-b82af8f97892', '126198e2-71fb-4714-a081-aac9115425e5', 'a26695bd-9ff5-4526-a94b-02596e3e3a10', '9dc4fc21-4f15-4505-b3f6-4a48c8dfad92'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:13 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:13 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:13 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.378s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Deleted volume successfully. Aug 26 03:04:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-72a66aed-2d11-46b2-9e85-3259ff96128e tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-746067f1-a86e-41c4-850e-73bdbfc55bbc-delete_volume" released by "delete_volume" :: held 9.807s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Flow 'volume_create_manager' (e32d5ce7-cbb8-486f-a436-fda580cdfa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7652e55a-0a17-44ed-8d44-32b857dba3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7652e55a-0a17-44ed-8d44-32b857dba3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-677310678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485cf283-ce06-4937-8888-80af0e1cefd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8292a0ec763d434ba175f348baf13122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:15Z,use_quota=True,user_id='c7526d0aab9743129d3344ce21d7c58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b71011-4abe-4195-992c-b4451c16f25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b71011-4abe-4195-992c-b4451c16f25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c554f931-9150-4bf5-a263-bef42866c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c554f931-9150-4bf5-a263-bef42866c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485cf283-ce06-4937-8888-80af0e1cefd8', 'volume_name': 'volume-485cf283-ce06-4937-8888-80af0e1cefd8', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022f0230-3401-43e3-a45c-1fa62a3362a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022f0230-3401-43e3-a45c-1fa62a3362a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ff05f1-4a36-4df9-bc58-ea542f2ca870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Volume 485cf283-ce06-4937-8888-80af0e1cefd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485cf283-ce06-4937-8888-80af0e1cefd8', 'volume_size': 1} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-677310678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485cf283-ce06-4937-8888-80af0e1cefd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8292a0ec763d434ba175f348baf13122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:15Z,use_quota=True,user_id='c7526d0aab9743129d3344ce21d7c58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Creating volume 485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:15 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:04:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:15 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 1073741824 Aug 26 03:04:15 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:16 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 1073741824" returned: 0 in 0.793s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:16 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 Aug 26 03:04:16 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:16 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8" returned: 0 in 0.344s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ff05f1-4a36-4df9-bc58-ea542f2ca870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485cf283-ce06-4937-8888-80af0e1cefd8', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31abdb32-ff79-42c7-8776-980822e77fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:16 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Volume volume-485cf283-ce06-4937-8888-80af0e1cefd8 (485cf283-ce06-4937-8888-80af0e1cefd8): created successfully Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31abdb32-ff79-42c7-8776-980822e77fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Flow 'volume_create_manager' (e32d5ce7-cbb8-486f-a436-fda580cdfa7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8075eaa1-7adb-4bd0-855b-e25b5b70294f tempest-VolumesDeleteCascade-1984299369 None] Created volume successfully. Aug 26 03:04:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e6da54cc-28e6-4c5e-b7f3-c0b3289a6ea9 tempest-GroupSnapshotsTest-1427967407 None] Group tempest-GroupSnapshotsTest-Group-859347812: creating Aug 26 03:04:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e6da54cc-28e6-4c5e-b7f3-c0b3289a6ea9 tempest-GroupSnapshotsTest-1427967407 None] Group tempest-GroupSnapshotsTest-Group-859347812: created successfully Aug 26 03:04:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e6da54cc-28e6-4c5e-b7f3-c0b3289a6ea9 tempest-GroupSnapshotsTest-1427967407 None] Create group completed successfully. Aug 26 03:04:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Creating offline snapshot ad48c44f-7e57-4579-9afb-20cab4100f10 of volume 485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:04:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8344a0ca-2d3b-4af5-847d-33b818378ea7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:18 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 Aug 26 03:04:18 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:18 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8" returned: 0 in 0.515s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:18 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 1G Aug 26 03:04:18 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Flow 'volume_create_manager' (15c0e7b1-3d6f-4238-b3e2-a2d6a38ed6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ce7758-506a-44cf-8803-ef599fb8ec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:19 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ce7758-506a-44cf-8803-ef599fb8ec06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-95105860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6193cb05-0643-4a66-9019-9e09115d1109,host='devstack@QuobyteHD#QuobyteHD',id=5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6075004e8a1d4b93a6f63f092881a232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:19Z,use_quota=True,user_id='5e2c58111b41466b802d7165df3a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d34dd0-59af-4ba8-ad53-a60e7b2dbaea),volume_type_id=59d34dd0-59af-4ba8-ad53-a60e7b2dbaea)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee03575-85a2-4b04-98d6-c62b39f11bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee03575-85a2-4b04-98d6-c62b39f11bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a805906c-ffe5-43f5-83c8-0930d1dfbedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a805906c-ffe5-43f5-83c8-0930d1dfbedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957', 'volume_name': 'volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa51028-64e6-414c-8265-dde01a734a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa51028-64e6-414c-8265-dde01a734a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549385f7-f15b-484e-b255-d5c40d476f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:19 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Volume 5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957', 'volume_size': 1} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 1G" returned: 0 in 0.808s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-485cf283-ce06-4937-8888-80af0e1cefd8 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:19 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-485cf283-ce06-4937-8888-80af0e1cefd8 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 Aug 26 03:04:19 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:19 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-485cf283-ce06-4937-8888-80af0e1cefd8 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10" returned: 0 in 0.366s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:19 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 is being set with open permissions: ugo+rw Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:19 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 Aug 26 03:04:19 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:19 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10" returned: 0 in 0.326s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:20 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.info Aug 26 03:04:20 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:20 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.info" returned: 0 in 0.353s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:20 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.info is being set with open permissions: ugo+rw Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:20 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.info Aug 26 03:04:20 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:20 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.info" returned: 0 in 0.396s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6193cb05-0643-4a66-9019-9e09115d1109,created_at=2026-08-26T01:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-95105860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6193cb05-0643-4a66-9019-9e09115d1109,host='devstack@QuobyteHD#QuobyteHD',id=5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6075004e8a1d4b93a6f63f092881a232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:19Z,use_quota=True,user_id='5e2c58111b41466b802d7165df3a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d34dd0-59af-4ba8-ad53-a60e7b2dbaea),volume_type_id=59d34dd0-59af-4ba8-ad53-a60e7b2dbaea)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Creating volume 5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:20 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:04:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:20 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 1073741824 Aug 26 03:04:20 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7097bd3b-a11d-45cc-8f69-3039f6201534 tempest-VolumesDeleteCascade-1984299369 None] Create snapshot completed successfully Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Flow 'volume_create_manager' (98f8ba84-45aa-4140-bdf6-5024c23a81b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d0a346-4427-4732-bafe-de1dbb810973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d0a346-4427-4732-bafe-de1dbb810973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1683903701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4689b0-ea34-490f-96cb-3c3e26f3eaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42d538341d34c45ad0c2c89fc14f7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:21Z,use_quota=True,user_id='6b8c990d810d4f2eafb834f5910991ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbea9997-a27f-419a-adbd-62a498d2ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbea9997-a27f-419a-adbd-62a498d2ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d2a61c-8f5a-43ed-90b7-36fe470be950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d2a61c-8f5a-43ed-90b7-36fe470be950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4689b0-ea34-490f-96cb-3c3e26f3eaac', 'volume_name': 'volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c89260-ab77-4457-815a-9dea602342df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c89260-ab77-4457-815a-9dea602342df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d6e1a5-2750-4ca8-bc7d-d5cd09887c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Volume 2b4689b0-ea34-490f-96cb-3c3e26f3eaac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac', 'volume_size': 1} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:21 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 1073741824" returned: 0 in 0.724s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:21 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 Aug 26 03:04:21 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:21 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" returned: 0 in 0.308s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1683903701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4689b0-ea34-490f-96cb-3c3e26f3eaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42d538341d34c45ad0c2c89fc14f7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:21Z,use_quota=True,user_id='6b8c990d810d4f2eafb834f5910991ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Creating volume 2b4689b0-ea34-490f-96cb-3c3e26f3eaac {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:21 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Flow 'volume_create_manager' (518a78fe-3a76-446f-a9e1-10cfad48ab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:21 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac 1073741824 Aug 26 03:04:22 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5db04d2-e527-433b-80ae-0a501e4c45b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549385f7-f15b-484e-b255-d5c40d476f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0cc403-8bf0-4685-b5f6-1609aa7d9d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5db04d2-e527-433b-80ae-0a501e4c45b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1421489320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47122919-7509-47a7-a288-79ef906aecbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8292a0ec763d434ba175f348baf13122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad48c44f-7e57-4579-9afb-20cab4100f10,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:22Z,use_quota=True,user_id='c7526d0aab9743129d3344ce21d7c58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e731d83-acac-4fcb-a819-a9cf1f5e9184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e731d83-acac-4fcb-a819-a9cf1f5e9184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde8a187-f616-46c3-9f1f-5401e4e14827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde8a187-f616-46c3-9f1f-5401e4e14827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47122919-7509-47a7-a288-79ef906aecbf', 'volume_name': 'volume-47122919-7509-47a7-a288-79ef906aecbf', 'volume_size': 1, 'snapshot_id': 'ad48c44f-7e57-4579-9afb-20cab4100f10'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e07e2a9-df6b-4275-818e-a7d886a15807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e07e2a9-df6b-4275-818e-a7d886a15807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5581768a-0d65-4ce9-ab7e-0ca4d334c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:22 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Volume 47122919-7509-47a7-a288-79ef906aecbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47122919-7509-47a7-a288-79ef906aecbf', 'volume_size': 1, 'snapshot_id': 'ad48c44f-7e57-4579-9afb-20cab4100f10'} Aug 26 03:04:22 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Volume volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 (5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957): created successfully Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0cc403-8bf0-4685-b5f6-1609aa7d9d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Flow 'volume_create_manager' (15c0e7b1-3d6f-4238-b3e2-a2d6a38ed6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:22 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7de983b9-918c-4f3b-99fd-6cf2a33e325e tempest-GroupSnapshotsTest-1427967407 None] Created volume successfully. Aug 26 03:04:22 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac 1073741824" returned: 0 in 0.536s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:22 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac Aug 26 03:04:22 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:22 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac" returned: 0 in 0.365s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.802s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-ad48c44f-7e57-4579-9afb-20cab4100f10-47122919-7509-47a7-a288-79ef906aecbf" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d6e1a5-2750-4ca8-bc7d-d5cd09887c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49737f7-6da7-4694-96e0-e879f2b106e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-ad48c44f-7e57-4579-9afb-20cab4100f10-47122919-7509-47a7-a288-79ef906aecbf" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Creating volume 47122919-7509-47a7-a288-79ef906aecbf from snapshot ad48c44f-7e57-4579-9afb-20cab4100f10 {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-47122919-7509-47a7-a288-79ef906aecbf" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:22 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Volume volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac (2b4689b0-ea34-490f-96cb-3c3e26f3eaac): created successfully Aug 26 03:04:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49737f7-6da7-4694-96e0-e879f2b106e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Flow 'volume_create_manager' (98f8ba84-45aa-4140-bdf6-5024c23a81b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-47122919-7509-47a7-a288-79ef906aecbf" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] snapshot: ad48c44f-7e57-4579-9afb-20cab4100f10, volume: 47122919-7509-47a7-a288-79ef906aecbf, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:04:23 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-db28a1c7-9fe3-408d-a8e7-00497eaa3a02 tempest-VolumesMetadataTest-1211079145 None] Created volume successfully. Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0911ce-89a5-4616-b465-4685082bceb4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:23 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 Aug 26 03:04:23 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:23 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] GroupSnapshot 02c868f1-d6af-42c1-9b2b-309050d760dc: creating. Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Group snapshot 02c868f1-d6af-42c1-9b2b-309050d760dc: creating. {{(pid=93797) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:23 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10" returned: 0 in 0.509s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-485cf283-ce06-4937-8888-80af0e1cefd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d17cef-fade-4242-ad60-051bbc23f9b6]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:23 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 Aug 26 03:04:23 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:24 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8" returned: 0 in 0.549s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:24 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf Aug 26 03:04:24 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Acquiring lock "cinder-2b4689b0-ea34-490f-96cb-3c3e26f3eaac-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Lock "cinder-2b4689b0-ea34-490f-96cb-3c3e26f3eaac-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Acquiring lock "cinder-quobyte-2b4689b0-ea34-490f-96cb-3c3e26f3eaac" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Lock "cinder-quobyte-2b4689b0-ea34-490f-96cb-3c3e26f3eaac" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ad6571-25f0-409e-b208-e4505465a9b9]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:24 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac Aug 26 03:04:24 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:25 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac" returned: 0 in 0.715s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:25 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac Aug 26 03:04:25 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:25 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2b4689b0-ea34-490f-96cb-3c3e26f3eaac" returned: 0 in 0.615s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Lock "cinder-quobyte-2b4689b0-ea34-490f-96cb-3c3e26f3eaac" released by "delete_volume" :: held 1.412s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:25 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=128,cinder:INSERT=39,cinder:UPDATE=167,cinder:DELETE=15 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:04:26 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:INSERT=43,cinder:UPDATE=159,cinder:SELECT=127,cinder:DELETE=13 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:04:26 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Created reservations ['6195adc3-27c8-4dc5-a549-90c30fe4bebf', '688cd554-dc1f-4598-ada2-aada85b0e6c5', '2efe1a1c-dc5a-462e-996f-1258cf2a8ab7', '3e05e9b2-463f-4829-8581-d8b535d6b8c9'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:26 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:26 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:27 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.643s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:27 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:27 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Deleted volume successfully. Aug 26 03:04:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a3efc95e-2b9d-4c8a-a4e8-6ada8d5299a3 tempest-VolumesMetadataTest-1211079145 None] Lock "cinder-2b4689b0-ea34-490f-96cb-3c3e26f3eaac-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:30 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf" returned: 0 in 6.685s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:30 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:04:30 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Converted 1024.00 MB image at 153.14 MB/s Aug 26 03:04:30 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf is being set with open permissions: ugo+rw Aug 26 03:04:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:30 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf Aug 26 03:04:30 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:31 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf" returned: 0 in 0.394s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-47122919-7509-47a7-a288-79ef906aecbf" released by "_copy_volume_from_snapshot" :: held 8.275s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-ad48c44f-7e57-4579-9afb-20cab4100f10-47122919-7509-47a7-a288-79ef906aecbf" released by "_create_volume_from_snapshot" :: held 8.421s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.461s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Creating offline snapshot 9ddc995d-28f3-4e61-b348-6a7020eb80b5 of volume 5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5581768a-0d65-4ce9-ab7e-0ca4d334c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47122919-7509-47a7-a288-79ef906aecbf', 'volume_size': 1, 'snapshot_id': 'ad48c44f-7e57-4579-9afb-20cab4100f10'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9dce37-e11d-4c09-a352-41be8c784995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e972613-b375-4626-bd7e-ad39e62c3438]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Volume volume-47122919-7509-47a7-a288-79ef906aecbf (47122919-7509-47a7-a288-79ef906aecbf): created successfully Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9dce37-e11d-4c09-a352-41be8c784995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Flow 'volume_create_manager' (518a78fe-3a76-446f-a9e1-10cfad48ab24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a4656023-9b89-4cfd-a653-60e35a237be0 tempest-VolumesDeleteCascade-1984299369 None] Created volume successfully. Aug 26 03:04:31 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 Aug 26 03:04:31 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:32 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" returned: 0 in 0.606s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:32 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 1G Aug 26 03:04:32 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-485cf283-ce06-4937-8888-80af0e1cefd8-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-485cf283-ce06-4937-8888-80af0e1cefd8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Performing cascade delete. {{(pid=93797) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-ad48c44f-7e57-4579-9afb-20cab4100f10-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-ad48c44f-7e57-4579-9afb-20cab4100f10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-485cf283-ce06-4937-8888-80af0e1cefd8" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-485cf283-ce06-4937-8888-80af0e1cefd8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-ad48c44f-7e57-4579-9afb-20cab4100f10" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-ad48c44f-7e57-4579-9afb-20cab4100f10" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Deleting offline snapshot ad48c44f-7e57-4579-9afb-20cab4100f10 of volume 485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] snapshot_file for this snap is: volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1530d38e-2176-40d2-835f-a016b7e501ee]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:32 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 Aug 26 03:04:32 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:32 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 1G" returned: 0 in 0.642s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:32 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 Aug 26 03:04:32 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:33 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10" returned: 0 in 0.635s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-485cf283-ce06-4937-8888-80af0e1cefd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed66f55-32f6-48de-8c87-e57eea309491]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:33 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5" returned: 0 in 0.483s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:33 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:33 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 Aug 26 03:04:33 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:33 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 Aug 26 03:04:33 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:33 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5" returned: 0 in 0.440s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:33 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.info Aug 26 03:04:33 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:33 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8" returned: 0 in 0.726s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:33 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 Aug 26 03:04:33 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:34 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.info" returned: 0 in 0.426s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:34 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:34 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.info Aug 26 03:04:34 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:34 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10" returned: 0 in 0.564s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:34 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10 Aug 26 03:04:34 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:34 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.info" returned: 0 in 0.476s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.259s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:34 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-17981e1f-513c-4585-82fd-52e57a59bdb3 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 02c868f1-d6af-42c1-9b2b-309050d760dc: created successfully Aug 26 03:04:34 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8.ad48c44f-7e57-4579-9afb-20cab4100f10" returned: 0 in 0.446s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-ad48c44f-7e57-4579-9afb-20cab4100f10" released by "_delete_snapshot" :: held 2.491s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-485cf283-ce06-4937-8888-80af0e1cefd8" released by "delete_snapshot" :: held 2.524s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:35 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Created reservations ['4ec76203-1a8c-445b-8b9d-b9aa51e31882', 'ff33b74b-ae57-4e7f-b4b6-e900476a5c03', 'ddf1f86d-8c7e-4110-93c8-1c89d403e347', '8f3124be-c4fb-4133-bd5e-54e12d33d98d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:35 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Delete snapshot completed successfully. Aug 26 03:04:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-ad48c44f-7e57-4579-9afb-20cab4100f10-delete_snapshot" released by "delete_snapshot" :: held 2.763s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Snapshots deleted, issuing volume delete {{(pid=93797) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 03:04:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-485cf283-ce06-4937-8888-80af0e1cefd8" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-485cf283-ce06-4937-8888-80af0e1cefd8" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:35 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c99e2-e349-4ec7-8d72-b52dd06f1a42]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:35 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 Aug 26 03:04:35 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:36 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8" returned: 0 in 0.770s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:36 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8 Aug 26 03:04:36 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:36 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-485cf283-ce06-4937-8888-80af0e1cefd8" returned: 0 in 0.430s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-485cf283-ce06-4937-8888-80af0e1cefd8" released by "delete_volume" :: held 1.343s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-9ddc995d-28f3-4e61-b348-6a7020eb80b5-c8273631-e2c6-4fd1-b2a6-75273aa63094" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-9ddc995d-28f3-4e61-b348-6a7020eb80b5-c8273631-e2c6-4fd1-b2a6-75273aa63094" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Creating volume c8273631-e2c6-4fd1-b2a6-75273aa63094 from snapshot 9ddc995d-28f3-4e61-b348-6a7020eb80b5 {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-c8273631-e2c6-4fd1-b2a6-75273aa63094" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-c8273631-e2c6-4fd1-b2a6-75273aa63094" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] snapshot: 9ddc995d-28f3-4e61-b348-6a7020eb80b5, volume: c8273631-e2c6-4fd1-b2a6-75273aa63094, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Created reservations ['6081b96b-d0eb-40c1-9af9-7683a778bd41', '188d1556-4055-4603-87be-46bda339654e', '65cb50df-6ea4-49bc-9592-f8d0ff47be26', '1e5a15b9-f940-45ab-8c8b-8fab088d6ec4'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852ff95-aa99-4e60-bb87-af9a38829dd6]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:36 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:36 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:36 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 Aug 26 03:04:36 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:37 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.407s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:37 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:37 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Deleted volume successfully. Aug 26 03:04:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9ceffd8-a449-48bd-8d12-2eddb8182cc6 tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-485cf283-ce06-4937-8888-80af0e1cefd8-delete_volume" released by "delete_volume" :: held 5.056s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:37 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5" returned: 0 in 0.690s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0618912d-6b67-42f3-aeef-34053a577b3f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:37 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 Aug 26 03:04:37 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:37 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" returned: 0 in 0.535s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:38 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 Aug 26 03:04:38 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-47122919-7509-47a7-a288-79ef906aecbf-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-47122919-7509-47a7-a288-79ef906aecbf-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "cinder-quobyte-47122919-7509-47a7-a288-79ef906aecbf" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-47122919-7509-47a7-a288-79ef906aecbf" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a3bb8f-83c5-4f48-bbf0-cc721a91a762]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:38 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf Aug 26 03:04:38 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:38 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf" returned: 0 in 0.568s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:39 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf Aug 26 03:04:39 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:39 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47122919-7509-47a7-a288-79ef906aecbf" returned: 0 in 1.022s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-quobyte-47122919-7509-47a7-a288-79ef906aecbf" released by "delete_volume" :: held 1.701s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:40 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Created reservations ['f8df15d4-4113-443e-9665-925ca96e98cf', '91b8f25f-c5e2-47d7-8aae-6e5da45ab0fc', '36480cfa-6402-4821-9f4f-4d31214d89a3', '43163eb4-b643-4471-9ef9-3e5d3fd7ef43'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:40 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:40 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:41 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 1.075s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:41 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Deleted volume successfully. Aug 26 03:04:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5ec5e6e2-8a6b-46d5-8583-30740194d2bb tempest-VolumesDeleteCascade-1984299369 None] Lock "cinder-47122919-7509-47a7-a288-79ef906aecbf-delete_volume" released by "delete_volume" :: held 3.653s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:44 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094" returned: 0 in 6.919s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:44 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:04:44 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Converted 1024.00 MB image at 147.97 MB/s Aug 26 03:04:44 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:04:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:44 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 Aug 26 03:04:44 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:45 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094" returned: 0 in 0.381s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-c8273631-e2c6-4fd1-b2a6-75273aa63094" released by "_copy_volume_from_snapshot" :: held 8.694s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-9ddc995d-28f3-4e61-b348-6a7020eb80b5-c8273631-e2c6-4fd1-b2a6-75273aa63094" released by "_create_volume_from_snapshot" :: held 8.798s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.819s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:45 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c3d43566-7cca-4a6f-8af9-6f0d76037687 tempest-GroupSnapshotsTest-1427967407 None] Create group from source-snapshot-02c868f1-d6af-42c1-9b2b-309050d760dc completed successfully. Aug 26 03:04:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-c8273631-e2c6-4fd1-b2a6-75273aa63094" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-c8273631-e2c6-4fd1-b2a6-75273aa63094" acquired by "delete_volume" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:46 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[57235d2e-cddd-4efd-994d-54b74a6e070c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:47 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 Aug 26 03:04:47 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:47 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094" returned: 0 in 0.621s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:47 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094 Aug 26 03:04:47 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:47 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c8273631-e2c6-4fd1-b2a6-75273aa63094" returned: 0 in 0.337s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-c8273631-e2c6-4fd1-b2a6-75273aa63094" released by "delete_volume" :: held 1.046s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['be73aab0-deac-4f76-8a6d-dd369f257ca6'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:48 devstack cinder-volume[93797]: WARNING cinder.quota [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1562472306 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1562472306, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:04:48 devstack cinder-volume[93797]: WARNING cinder.quota [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1562472306 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1562472306, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['475492cf-f367-4452-a189-da58c91bce8f', '4cab3c17-50ba-4e52-bfa2-fca4ffe8d921', 'babc5a60-d9b7-4efb-99cb-844852976743', '9ba449f0-69ce-4393-b3b7-40ff2c8f64a9'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:48 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:48 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:48 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.359s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:48 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:48 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-76b630b6-9f86-4628-a706-fb1813a50919 tempest-GroupSnapshotsTest-1427967407 None] Delete group completed successfully. Aug 26 03:04:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 02c868f1-d6af-42c1-9b2b-309050d760dc: deleting Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 02c868f1-d6af-42c1-9b2b-309050d760dc: deleting {{(pid=93797) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-9ddc995d-28f3-4e61-b348-6a7020eb80b5" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-9ddc995d-28f3-4e61-b348-6a7020eb80b5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Deleting offline snapshot 9ddc995d-28f3-4e61-b348-6a7020eb80b5 of volume 5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] snapshot_file for this snap is: volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c38db-e9a3-4b6d-b152-ae0b1b03e1b0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:50 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 Aug 26 03:04:50 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:50 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5" returned: 0 in 0.685s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8781fc-0756-4e93-a0a4-847b710f24e3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Flow 'volume_create_manager' (fea05fcf-5561-458f-85ad-d3cd7d0fbe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dd513d-de37-4bdb-b392-876cdd9f3a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dd513d-de37-4bdb-b392-876cdd9f3a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f083dd9c-e684-4f83-9bbb-1c4e5db5cdea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de39fd6b01f4770a6b8b2e66e19caac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:50Z,use_quota=True,user_id='65c9a8265d25441e85d5eb106bac27ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f8b63be-7644-4a0b-a81b-81a36b4cec4e),volume_type_id=5f8b63be-7644-4a0b-a81b-81a36b4cec4e)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bd2d47-32bd-4409-b75d-76116dc3c07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bd2d47-32bd-4409-b75d-76116dc3c07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cec17a5-d770-41b4-9fe0-b4ae33671f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:50 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:04:50 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 Aug 26 03:04:50 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cec17a5-d770-41b4-9fe0-b4ae33671f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f083dd9c-e684-4f83-9bbb-1c4e5db5cdea', 'volume_name': 'volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea', 'volume_size': 1, 'image_id': 'af532779-6012-4a55-8dbe-d05e09c49f32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af532779-6012-4a55-8dbe-d05e09c49f32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '675a000ce845427e7fb793103fdc2b8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7de39fd6b01f4770a6b8b2e66e19caac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '140a857a1dffdcac9e94601d5ffaf4dabad102a766b6535579c249d84d620d8f86ef71f7e4a0cae2e6b0c336a57c705eb32414e69752f92d252f8a3193c054ae', 'id': 'af532779-6012-4a55-8dbe-d05e09c49f32', 'created_at': datetime.datetime(2026, 8, 26, 1, 4, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 4, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af532779-6012-4a55-8dbe-d05e09c49f32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e3f9dd-eef6-423d-bc9c-7a8f9dcdcb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e3f9dd-eef6-423d-bc9c-7a8f9dcdcb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a09f77-b285-4faf-a555-5af61881a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:51 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Volume f083dd9c-e684-4f83-9bbb-1c4e5db5cdea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea', 'volume_size': 1, 'image_id': 'af532779-6012-4a55-8dbe-d05e09c49f32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af532779-6012-4a55-8dbe-d05e09c49f32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '675a000ce845427e7fb793103fdc2b8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7de39fd6b01f4770a6b8b2e66e19caac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '140a857a1dffdcac9e94601d5ffaf4dabad102a766b6535579c249d84d620d8f86ef71f7e4a0cae2e6b0c336a57c705eb32414e69752f92d252f8a3193c054ae', 'id': 'af532779-6012-4a55-8dbe-d05e09c49f32', 'created_at': datetime.datetime(2026, 8, 26, 1, 4, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 4, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af532779-6012-4a55-8dbe-d05e09c49f32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Trying to clone f083dd9c-e684-4f83-9bbb-1c4e5db5cdea from image af532779-6012-4a55-8dbe-d05e09c49f32 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af532779-6012-4a55-8dbe-d05e09c49f32', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:04:51 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" returned: 0 in 0.787s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:51 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 Aug 26 03:04:51 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:04:51 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Image download 0.00 MB at 0.00 MB/s Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f9784d-85ae-48c5-b98a-25a495acc13c]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:51 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD Aug 26 03:04:51 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:52 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Flow 'volume_create_manager' (c92daa6d-93d0-485a-b6c4-123ecf22fdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d825c28f-2fe9-4779-ab90-9ace07e4c8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5" returned: 0 in 0.780s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:52 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d825c28f-2fe9-4779-ab90-9ace07e4c8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1779959948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbffe33c-503b-4265-af31-3c358fdcca7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18302708b63f49c1b95c583b0dc2f22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:52Z,use_quota=True,user_id='e75f3b0eafdc4325921704c4fca54ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdf8ada-6938-408d-9c11-a9897c49aa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5 Aug 26 03:04:52 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdf8ada-6938-408d-9c11-a9897c49aa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2649865-b343-44f6-b4e4-8795a47515c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2649865-b343-44f6-b4e4-8795a47515c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbffe33c-503b-4265-af31-3c358fdcca7d', 'volume_name': 'volume-bbffe33c-503b-4265-af31-3c358fdcca7d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e91527-fc19-44f2-801b-3125b9f58595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e91527-fc19-44f2-801b-3125b9f58595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8351e9d-def3-43d7-bff4-43e42194bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Volume bbffe33c-503b-4265-af31-3c358fdcca7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbffe33c-503b-4265-af31-3c358fdcca7d', 'volume_size': 1} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1779959948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbffe33c-503b-4265-af31-3c358fdcca7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18302708b63f49c1b95c583b0dc2f22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:52Z,use_quota=True,user_id='e75f3b0eafdc4325921704c4fca54ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Creating volume bbffe33c-503b-4265-af31-3c358fdcca7d {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:52 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:52 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d 1073741824 Aug 26 03:04:52 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:52 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD Aug 26 03:04:52 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:52 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957.9ddc995d-28f3-4e61-b348-6a7020eb80b5" returned: 0 in 0.551s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-9ddc995d-28f3-4e61-b348-6a7020eb80b5" released by "_delete_snapshot" :: held 3.006s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" released by "delete_snapshot" :: held 3.045s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:52 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD" returned: 1 in 0.534s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Temporary image af532779-6012-4a55-8dbe-d05e09c49f32 is fetched for user 65c9a8265d25441e85d5eb106bac27ac. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:04:52 devstack cinder-volume[93797]: WARNING cinder.quota [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1562472306 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1562472306, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b586e66f-5bf7-4a2d-8a3e-495f3800b897]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:52 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['ff5a01e4-0c12-4cbe-8968-07abd1bd4f8f', '93b1e6c0-711f-40cb-8289-cd1c3f5e4b07', '5a3dc7b9-658a-41c9-b520-3e8311e45117', '5d6565e8-48e5-4ab9-914d-041fc2980153'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ccc667eb-f28a-42e6-a1a4-d89fba06ba28 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 02c868f1-d6af-42c1-9b2b-309050d760dc: deleted successfully Aug 26 03:04:53 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD Aug 26 03:04:53 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:53 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d 1073741824" returned: 0 in 0.853s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:53 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d Aug 26 03:04:53 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:53 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d" returned: 0 in 0.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:53 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8351e9d-def3-43d7-bff4-43e42194bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbffe33c-503b-4265-af31-3c358fdcca7d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c1f251-762e-42f9-b487-e6bf8cbf1eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:53 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Volume volume-bbffe33c-503b-4265-af31-3c358fdcca7d (bbffe33c-503b-4265-af31-3c358fdcca7d): created successfully Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c1f251-762e-42f9-b487-e6bf8cbf1eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Flow 'volume_create_manager' (c92daa6d-93d0-485a-b6c4-123ecf22fdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" acquired by "delete_volume" :: waited 0.042s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-21ddbe2e-c33a-4309-a850-bcef84793b70 tempest-VolumesTransfersV355Test-1734565871 None] Created volume successfully. Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79f882f-4d2d-48a8-9edc-7575e75b9521]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:53 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD Aug 26 03:04:53 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Flow 'volume_create_manager' (336d8497-7f7f-4d9e-bcf0-e50d367ec56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11ae686-ebc2-4b3f-a694-553e5b0d1d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11ae686-ebc2-4b3f-a694-553e5b0d1d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2004930770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d138324-201e-42e0-b9b4-eea27642b1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2724c5cc0aa74d6ba0a90d4b304de606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:53Z,use_quota=True,user_id='d5f5e3f3f2dc49f8a0f80a5430ff0219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0d7441-6676-4c6d-952b-d7ba21731a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0d7441-6676-4c6d-952b-d7ba21731a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca57244-c0f9-4d1e-a22d-5676a599e103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca57244-c0f9-4d1e-a22d-5676a599e103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d138324-201e-42e0-b9b4-eea27642b1d2', 'volume_name': 'volume-7d138324-201e-42e0-b9b4-eea27642b1d2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4730c6-e610-458f-8a5f-7a37514828e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4730c6-e610-458f-8a5f-7a37514828e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1b5f49-08b2-4f0a-ad8a-c4c6e82d1fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:53 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Volume 7d138324-201e-42e0-b9b4-eea27642b1d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d138324-201e-42e0-b9b4-eea27642b1d2', 'volume_size': 1} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2004930770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d138324-201e-42e0-b9b4-eea27642b1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2724c5cc0aa74d6ba0a90d4b304de606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:53Z,use_quota=True,user_id='d5f5e3f3f2dc49f8a0f80a5430ff0219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Creating volume 7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:53 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:53 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 1073741824 Aug 26 03:04:53 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 Aug 26 03:04:53 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:53 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:53 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:04:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:54 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" returned: 0 in 0.385s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:54 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957 Aug 26 03:04:54 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:54 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 1073741824" returned: 0 in 0.545s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:54 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" returned: 0 in 0.317s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:54 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:04:54 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-5737d19c-8ff6-4c65-9d7d-a3b2f3cb6957" released by "delete_volume" :: held 0.825s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['c674a454-b747-40bb-abe1-f1d38ddbd67a'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:54 devstack cinder-volume[93797]: WARNING cinder.db.api [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1562472306'] Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['0a6e52fc-8ea7-41c7-85ab-ced0aeb423f1', '011735f6-9a74-4092-acb1-d25426bf5f3d', '3d9790a3-5599-4134-99ff-03117b250472', '2b645898-4741-4422-948e-b01239dfafb1'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:54 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f083dd9c-e684-4f83-9bbb-1c4e5db5cdea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de39fd6b01f4770a6b8b2e66e19caac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:50Z,use_quota=True,user_id='65c9a8265d25441e85d5eb106bac27ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f8b63be-7644-4a0b-a81b-81a36b4cec4e),volume_type_id=5f8b63be-7644-4a0b-a81b-81a36b4cec4e)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Creating volume f083dd9c-e684-4f83-9bbb-1c4e5db5cdea {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:54 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1b5f49-08b2-4f0a-ad8a-c4c6e82d1fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d138324-201e-42e0-b9b4-eea27642b1d2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:54 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea 1073741824 Aug 26 03:04:54 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6db1b1-6c1d-4aae-a373-55208cc323fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:54 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Volume volume-7d138324-201e-42e0-b9b4-eea27642b1d2 (7d138324-201e-42e0-b9b4-eea27642b1d2): created successfully Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6db1b1-6c1d-4aae-a373-55208cc323fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Flow 'volume_create_manager' (336d8497-7f7f-4d9e-bcf0-e50d367ec56e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:54 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:54 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ab111922-602f-4099-9619-dc78bb2ce590 tempest-VolumesActionsTest-2104509767 None] Created volume successfully. Aug 26 03:04:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4eac82dc-3e06-48f7-9fb9-48a398feca22 tempest-VolumesTransfersV355Test-1103717916 None] Transfer volume completed successfully. Aug 26 03:04:55 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.322s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:55 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f7dabc7e-a604-415b-9e5d-383219fc1095 tempest-GroupSnapshotsTest-1427967407 None] Delete group completed successfully. Aug 26 03:04:55 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea 1073741824" returned: 0 in 0.569s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:55 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea Aug 26 03:04:55 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Acquiring lock "cinder-bbffe33c-503b-4265-af31-3c358fdcca7d-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Lock "cinder-bbffe33c-503b-4265-af31-3c358fdcca7d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Acquiring lock "cinder-quobyte-bbffe33c-503b-4265-af31-3c358fdcca7d" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Lock "cinder-quobyte-bbffe33c-503b-4265-af31-3c358fdcca7d" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:55 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea" returned: 0 in 0.328s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d86962-d958-4f2e-8e7c-ff1058014d8f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Attempting download of af532779-6012-4a55-8dbe-d05e09c49f32 ((None, [{'url': 'file:///opt/stack/data/glance/images/af532779-6012-4a55-8dbe-d05e09c49f32', 'metadata': {}}])) to volume f083dd9c-e684-4f83-9bbb-1c4e5db5cdea. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae0498f-8bd0-467c-83c1-9204e22b5576]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af532779-6012-4a55-8dbe-d05e09c49f32_bixqxkw5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:55 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d Aug 26 03:04:55 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:55 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af532779-6012-4a55-8dbe-d05e09c49f32_bixqxkw5 Aug 26 03:04:55 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:56 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:56 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d" returned: 0 in 0.507s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af532779-6012-4a55-8dbe-d05e09c49f32_bixqxkw5" returned: 0 in 0.437s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af532779-6012-4a55-8dbe-d05e09c49f32_bixqxkw5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:56 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d Aug 26 03:04:56 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:56 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af532779-6012-4a55-8dbe-d05e09c49f32_bixqxkw5 Aug 26 03:04:56 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-86c47454-cc24-45ef-8567-7bbcd6d80dba tempest-GroupSnapshotsTest-1427967407 None] Group tempest-GroupSnapshotsTest-Group-608841308: creating Aug 26 03:04:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-86c47454-cc24-45ef-8567-7bbcd6d80dba tempest-GroupSnapshotsTest-1427967407 None] Group tempest-GroupSnapshotsTest-Group-608841308: created successfully Aug 26 03:04:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-86c47454-cc24-45ef-8567-7bbcd6d80dba tempest-GroupSnapshotsTest-1427967407 None] Create group completed successfully. Aug 26 03:04:56 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bbffe33c-503b-4265-af31-3c358fdcca7d" returned: 0 in 0.362s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Lock "cinder-quobyte-bbffe33c-503b-4265-af31-3c358fdcca7d" released by "delete_volume" :: held 0.931s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:56 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af532779-6012-4a55-8dbe-d05e09c49f32_bixqxkw5" returned: 1 in 0.410s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af532779-6012-4a55-8dbe-d05e09c49f32_bixqxkw5' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[32adbf67-fb9b-4908-a08b-bfd8cc2d4109]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Created reservations ['34fee870-053b-4bb4-a769-e168faf1233e', 'cddd3d8b-87ec-4901-bfe8-6bfff7a8535e', '55d0d7e9-2661-4d69-afa3-c955789e23ed', '4420f418-780d-4f32-8b0e-0c32a9ac56a3'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:56 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD Aug 26 03:04:56 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:56 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:04:56 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:57 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:57 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.341s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:57 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Deleted volume successfully. Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d021282-1209-424c-9ee4-cd2ec5a75f2c tempest-VolumesTransfersV355Test-244897867 None] Lock "cinder-bbffe33c-503b-4265-af31-3c358fdcca7d-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:57 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD Aug 26 03:04:57 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:57 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] af532779-6012-4a55-8dbe-d05e09c49f32 was raw, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:04:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:57 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea Aug 26 03:04:57 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:58 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea" returned: 0 in 0.864s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af532779-6012-4a55-8dbe-d05e09c49f32_o7z4dzbbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:04:58 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:58 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea 1G Aug 26 03:04:58 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Flow 'volume_create_manager' (571f0af4-41f8-4be1-9984-808d3833ac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae559ad8-92f5-4561-bc6a-d0982c3d0c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae559ad8-92f5-4561-bc6a-d0982c3d0c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-415588142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abeeb6c7-2f18-4610-ae56-9e84bee1148d,host='devstack@QuobyteHD#QuobyteHD',id=a60cf9f6-eb4c-49d8-bee7-e2217582b231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6075004e8a1d4b93a6f63f092881a232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:58Z,use_quota=True,user_id='5e2c58111b41466b802d7165df3a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fa82413-1b72-4144-b351-a522a48e96b7),volume_type_id=9fa82413-1b72-4144-b351-a522a48e96b7)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81f0a90-0de3-4e89-9235-22e4f87609c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81f0a90-0de3-4e89-9235-22e4f87609c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e42e30-28cf-463f-8272-5d137fdb9207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e42e30-28cf-463f-8272-5d137fdb9207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60cf9f6-eb4c-49d8-bee7-e2217582b231', 'volume_name': 'volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0722b15e-6f5e-434f-9adc-fb6b6d676b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0722b15e-6f5e-434f-9adc-fb6b6d676b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977752c7-93cc-4750-b4d9-1e6149f3b0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Volume a60cf9f6-eb4c-49d8-bee7-e2217582b231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231', 'volume_size': 1} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=abeeb6c7-2f18-4610-ae56-9e84bee1148d,created_at=2026-08-26T01:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-415588142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abeeb6c7-2f18-4610-ae56-9e84bee1148d,host='devstack@QuobyteHD#QuobyteHD',id=a60cf9f6-eb4c-49d8-bee7-e2217582b231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6075004e8a1d4b93a6f63f092881a232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:58Z,use_quota=True,user_id='5e2c58111b41466b802d7165df3a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fa82413-1b72-4144-b351-a522a48e96b7),volume_type_id=9fa82413-1b72-4144-b351-a522a48e96b7)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Creating volume a60cf9f6-eb4c-49d8-bee7-e2217582b231 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:58 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:58 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:58 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 1073741824 Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea 1G" returned: 0 in 0.562s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Downloaded image af532779-6012-4a55-8dbe-d05e09c49f32 ((None, [{'url': 'file:///opt/stack/data/glance/images/af532779-6012-4a55-8dbe-d05e09c49f32', 'metadata': {}}])) to volume f083dd9c-e684-4f83-9bbb-1c4e5db5cdea successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:04:58 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Temporary image af532779-6012-4a55-8dbe-d05e09c49f32 for user 65c9a8265d25441e85d5eb106bac27ac is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Marking volume f083dd9c-e684-4f83-9bbb-1c4e5db5cdea as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Copying metadata from image af532779-6012-4a55-8dbe-d05e09c49f32 to f083dd9c-e684-4f83-9bbb-1c4e5db5cdea. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Creating volume glance metadata for volume f083dd9c-e684-4f83-9bbb-1c4e5db5cdea backed by image af532779-6012-4a55-8dbe-d05e09c49f32 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'af532779-6012-4a55-8dbe-d05e09c49f32', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '675a000ce845427e7fb793103fdc2b8d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Flow 'volume_create_manager' (8c544fd8-b604-4c24-a312-cb1d8c157527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b485e044-6461-4347-a19b-09e3c3ff43d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b485e044-6461-4347-a19b-09e3c3ff43d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667342854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dcf60c-5755-43c8-9285-1e00009bfd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18302708b63f49c1b95c583b0dc2f22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:59Z,use_quota=True,user_id='e75f3b0eafdc4325921704c4fca54ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97084a6f-3726-45b2-9b98-14c9c6006d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97084a6f-3726-45b2-9b98-14c9c6006d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1676f01-5652-4709-8034-85dcfe4fe949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1676f01-5652-4709-8034-85dcfe4fe949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51dcf60c-5755-43c8-9285-1e00009bfd88', 'volume_name': 'volume-51dcf60c-5755-43c8-9285-1e00009bfd88', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320ec7d1-4714-465a-8b20-96c16748be12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320ec7d1-4714-465a-8b20-96c16748be12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41acd21-52a1-454a-91de-42f635867e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Volume 51dcf60c-5755-43c8-9285-1e00009bfd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51dcf60c-5755-43c8-9285-1e00009bfd88', 'volume_size': 1} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a09f77-b285-4faf-a555-5af61881a93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea', 'volume_size': 1, 'image_id': 'af532779-6012-4a55-8dbe-d05e09c49f32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af532779-6012-4a55-8dbe-d05e09c49f32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '675a000ce845427e7fb793103fdc2b8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7de39fd6b01f4770a6b8b2e66e19caac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '140a857a1dffdcac9e94601d5ffaf4dabad102a766b6535579c249d84d620d8f86ef71f7e4a0cae2e6b0c336a57c705eb32414e69752f92d252f8a3193c054ae', 'id': 'af532779-6012-4a55-8dbe-d05e09c49f32', 'created_at': datetime.datetime(2026, 8, 26, 1, 4, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 4, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af532779-6012-4a55-8dbe-d05e09c49f32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c37722-d42f-4470-b94d-c834a199a389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Volume volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea (f083dd9c-e684-4f83-9bbb-1c4e5db5cdea): created successfully Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c37722-d42f-4470-b94d-c834a199a389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Flow 'volume_create_manager' (fea05fcf-5561-458f-85ad-d3cd7d0fbe04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-541ca9d3-45e1-4106-96d8-f639d27c489a tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Created volume successfully. Aug 26 03:04:59 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 1073741824" returned: 0 in 0.690s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Acquiring lock "cinder-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "cinder-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:59 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 Aug 26 03:04:59 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Acquiring lock "cinder-quobyte-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "cinder-quobyte-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea" acquired by "delete_volume" :: waited 0.045s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7a0f30-54a8-43e6-872b-a3fec8589f8b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:59 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea Aug 26 03:04:59 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:59 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231" returned: 0 in 0.447s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667342854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dcf60c-5755-43c8-9285-1e00009bfd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18302708b63f49c1b95c583b0dc2f22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:59Z,use_quota=True,user_id='e75f3b0eafdc4325921704c4fca54ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Creating volume 51dcf60c-5755-43c8-9285-1e00009bfd88 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:00 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977752c7-93cc-4750-b4d9-1e6149f3b0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc95f101-270b-4122-9061-46a25f614417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:00 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 1073741824 Aug 26 03:05:00 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:00 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Volume volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 (a60cf9f6-eb4c-49d8-bee7-e2217582b231): created successfully Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc95f101-270b-4122-9061-46a25f614417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Flow 'volume_create_manager' (571f0af4-41f8-4be1-9984-808d3833ac59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-823ea744-cd44-4279-81a1-8585ea219285 tempest-GroupSnapshotsTest-1427967407 None] Created volume successfully. Aug 26 03:05:00 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea" returned: 0 in 0.597s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:00 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea Aug 26 03:05:00 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:00 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea" returned: 0 in 0.328s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "cinder-quobyte-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea" released by "delete_volume" :: held 1.007s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:00 devstack cinder-volume[93797]: WARNING cinder.quota [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:05:00 devstack cinder-volume[93797]: WARNING cinder.quota [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Created reservations ['7a8c8f34-d65d-4f64-8b96-661d6918fbcb', '3c069c31-f670-4ae0-bd5a-3ab254badf47', 'b58f955e-8dea-4479-881a-11dee7346dcd', '5e2eb2a6-425a-4b10-9e68-11b7823214a3'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:00 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 1073741824" returned: 0 in 0.772s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:00 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 Aug 26 03:05:00 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:00 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:00 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:01 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88" returned: 0 in 0.333s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:01 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.311s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41acd21-52a1-454a-91de-42f635867e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51dcf60c-5755-43c8-9285-1e00009bfd88', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a99502-ca4e-45e5-88f1-70bd555b2b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:01 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Deleted volume successfully. Aug 26 03:05:01 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Volume volume-51dcf60c-5755-43c8-9285-1e00009bfd88 (51dcf60c-5755-43c8-9285-1e00009bfd88): created successfully Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a99502-ca4e-45e5-88f1-70bd555b2b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Flow 'volume_create_manager' (8c544fd8-b604-4c24-a312-cb1d8c157527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dc9d59d-8b35-47b0-ba2b-2442b2eb4d5b tempest-VolumeAndVolumeTypeFromImageTest-2063584582 None] Lock "cinder-f083dd9c-e684-4f83-9bbb-1c4e5db5cdea-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:01 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-23eb2c16-1b06-430c-9fd9-c0db5641775a tempest-VolumesTransfersV355Test-1734565871 None] Created volume successfully. Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Flow 'volume_create_manager' (33812425-223f-4980-8f8d-eebe8a087d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8c8d5e-21e4-49b2-b2ff-a71914047549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8c8d5e-21e4-49b2-b2ff-a71914047549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1376515696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abeeb6c7-2f18-4610-ae56-9e84bee1148d,host='devstack@QuobyteHD#QuobyteHD',id=ea7e4df7-a8d0-426a-84b1-f29620db2035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6075004e8a1d4b93a6f63f092881a232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:02Z,use_quota=True,user_id='5e2c58111b41466b802d7165df3a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fa82413-1b72-4144-b351-a522a48e96b7),volume_type_id=9fa82413-1b72-4144-b351-a522a48e96b7)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cc84ab-2984-4683-bb25-dd6420038b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cc84ab-2984-4683-bb25-dd6420038b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69dd89cf-19b6-4729-9bc0-074030bba2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69dd89cf-19b6-4729-9bc0-074030bba2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7e4df7-a8d0-426a-84b1-f29620db2035', 'volume_name': 'volume-ea7e4df7-a8d0-426a-84b1-f29620db2035', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3335e64-3767-4705-96d6-dc3d5c584f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3335e64-3767-4705-96d6-dc3d5c584f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bb0ccc-9b4e-4e0d-bd88-498475439343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:01 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Volume ea7e4df7-a8d0-426a-84b1-f29620db2035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7e4df7-a8d0-426a-84b1-f29620db2035', 'volume_size': 1} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=abeeb6c7-2f18-4610-ae56-9e84bee1148d,created_at=2026-08-26T01:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1376515696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abeeb6c7-2f18-4610-ae56-9e84bee1148d,host='devstack@QuobyteHD#QuobyteHD',id=ea7e4df7-a8d0-426a-84b1-f29620db2035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6075004e8a1d4b93a6f63f092881a232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:02Z,use_quota=True,user_id='5e2c58111b41466b802d7165df3a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fa82413-1b72-4144-b351-a522a48e96b7),volume_type_id=9fa82413-1b72-4144-b351-a522a48e96b7)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Creating volume ea7e4df7-a8d0-426a-84b1-f29620db2035 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:01 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:02 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 1073741824 Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:02 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:02 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:02 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:02 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.549s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:05:02 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 1073741824" returned: 0 in 0.786s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Acquiring lock "cinder-51dcf60c-5755-43c8-9285-1e00009bfd88-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Lock "cinder-51dcf60c-5755-43c8-9285-1e00009bfd88-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:02 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 Aug 26 03:05:02 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Acquiring lock "cinder-quobyte-51dcf60c-5755-43c8-9285-1e00009bfd88" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Lock "cinder-quobyte-51dcf60c-5755-43c8-9285-1e00009bfd88" acquired by "delete_volume" :: waited 0.030s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7900b34-876b-4ac2-98d8-b560da27c09b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:03 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 Aug 26 03:05:03 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:03 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035" returned: 0 in 0.676s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bb0ccc-9b4e-4e0d-bd88-498475439343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7e4df7-a8d0-426a-84b1-f29620db2035', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93f28f3-1f18-45aa-b1d6-2f0c30938829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:03 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Volume volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 (ea7e4df7-a8d0-426a-84b1-f29620db2035): created successfully Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93f28f3-1f18-45aa-b1d6-2f0c30938829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Flow 'volume_create_manager' (33812425-223f-4980-8f8d-eebe8a087d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-679b83c3-ec34-4342-a29c-f0282448e9c7 tempest-GroupSnapshotsTest-1427967407 None] Created volume successfully. Aug 26 03:05:03 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88" returned: 0 in 0.924s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:03 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88 Aug 26 03:05:03 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:04 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-51dcf60c-5755-43c8-9285-1e00009bfd88" returned: 0 in 0.436s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Lock "cinder-quobyte-51dcf60c-5755-43c8-9285-1e00009bfd88" released by "delete_volume" :: held 1.442s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Created reservations ['2ecbe885-113f-4490-a4e9-04d60b6a7150', '797d9cab-cca6-4818-8e72-7457550f9e54', '9f24d8f5-fbfd-46f1-9044-de5352da3060', '18e44c7d-71a4-49d9-a75d-60a08984c65b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:04 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:04 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:04 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a4a6daaa-c77a-40a2-8aac-f6ee2b64b5cc tempest-GroupSnapshotsTest-1427967407 None] Update group completed successfully. Aug 26 03:05:05 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.425s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:05 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:05 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Deleted volume successfully. Aug 26 03:05:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0746c5f5-52c5-4515-94ba-e01ad347e58a tempest-VolumesTransfersV355Test-244897867 None] Lock "cinder-51dcf60c-5755-43c8-9285-1e00009bfd88-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-03fd3421-0ef8-4546-b4f8-510feadca275 tempest-GroupSnapshotsTest-1427967407 None] Update group completed successfully. Aug 26 03:05:07 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-173cd00f-b538-4192-97de-9bb738c65372 tempest-GroupSnapshotsTest-1427967407 None] Update group completed successfully. Aug 26 03:05:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-78d34f95-cc7b-481e-8e22-f22eb106529a tempest-GroupSnapshotsTest-1427967407 None] Update group completed successfully. Aug 26 03:05:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e74578f-05d1-431e-b2b3-17220393d967 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2" by "attach_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e74578f-05d1-431e-b2b3-17220393d967 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2" acquired by "attach_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0e74578f-05d1-431e-b2b3-17220393d967 tempest-VolumesActionsTest-2104509767 None] Attaching volume 7d138324-201e-42e0-b9b4-eea27642b1d2 to instance 7d6bcfe1-a9e6-49ac-b581-2f7eafac2be3 at mountpoint /dev/vdb on host None. Aug 26 03:05:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0e74578f-05d1-431e-b2b3-17220393d967 tempest-VolumesActionsTest-2104509767 None] Attach volume completed successfully. Aug 26 03:05:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e74578f-05d1-431e-b2b3-17220393d967 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2" released by "attach_volume" :: held 0.159s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-91967346-31c0-4a1a-832d-1f2e1a67462d tempest-VolumesActionsTest-2104509767 None] Acquiring lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-detach_volume" by "detach_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-91967346-31c0-4a1a-832d-1f2e1a67462d tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-detach_volume" acquired by "detach_volume" :: waited 0.058s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-91967346-31c0-4a1a-832d-1f2e1a67462d tempest-VolumesActionsTest-2104509767 None] Detaching volume 7d138324-201e-42e0-b9b4-eea27642b1d2 from instance 7d6bcfe1-a9e6-49ac-b581-2f7eafac2be3. Aug 26 03:05:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-91967346-31c0-4a1a-832d-1f2e1a67462d tempest-VolumesActionsTest-2104509767 None] Detach volume completed successfully. Aug 26 03:05:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-91967346-31c0-4a1a-832d-1f2e1a67462d tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] GroupSnapshot 4151f021-fe50-4f97-b78b-386a50e80cc1: creating. Aug 26 03:05:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Group snapshot 4151f021-fe50-4f97-b78b-386a50e80cc1: creating. {{(pid=93797) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 03:05:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Creating offline snapshot 0b82acb0-35cc-437d-bba4-411c6a0d59bc of volume ea7e4df7-a8d0-426a-84b1-f29620db2035 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:05:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c1e5d1-76c7-4e54-bb69-583ae56f04b1]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:11 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 Aug 26 03:05:11 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:11 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035" returned: 0 in 0.655s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:11 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc 1G Aug 26 03:05:11 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:12 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc 1G" returned: 0 in 0.835s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:12 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:12 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (b880db14-7957-477e-9066-d5f46d4172b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fe04f6-cb94-4be1-ab99-8293beb8f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fe04f6-cb94-4be1-ab99-8293beb8f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825112580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89f5c1a-3c69-43b4-a802-afda5f23d725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:12Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fc69ac-e578-4888-960a-584ccbcee92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fc69ac-e578-4888-960a-584ccbcee92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfade143-c3f1-4766-a89b-66a88de68fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfade143-c3f1-4766-a89b-66a88de68fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89f5c1a-3c69-43b4-a802-afda5f23d725', 'volume_name': 'volume-c89f5c1a-3c69-43b4-a802-afda5f23d725', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b20e3d4-fe8d-41d4-9bfa-b87d68e32253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b20e3d4-fe8d-41d4-9bfa-b87d68e32253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fa3aa4-ff95-43e4-8180-3f8c2758f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:12 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume c89f5c1a-3c69-43b4-a802-afda5f23d725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89f5c1a-3c69-43b4-a802-afda5f23d725', 'volume_size': 1} Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:12 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc" returned: 0 in 0.514s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:12 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:05:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:12 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc Aug 26 03:05:12 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:13 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc" returned: 0 in 0.340s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:13 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.info Aug 26 03:05:13 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:13 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.info" returned: 0 in 0.351s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:13 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:05:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:13 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.info Aug 26 03:05:13 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:13 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.info" returned: 0 in 0.294s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.127s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Creating offline snapshot d9530b0a-cecf-4cfc-8e31-e822400efd2c of volume a60cf9f6-eb4c-49d8-bee7-e2217582b231 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:05:14 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39abda3-b108-4c3c-aaab-015bc018dd69]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:14 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 Aug 26 03:05:14 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:14 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231" returned: 0 in 0.487s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:14 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c 1G Aug 26 03:05:14 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:15 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c 1G" returned: 0 in 0.587s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:15 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c Aug 26 03:05:15 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:15 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c" returned: 0 in 0.387s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:15 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:15 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c Aug 26 03:05:15 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:15 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c" returned: 0 in 0.331s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:15 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.info Aug 26 03:05:15 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Flow 'volume_create_manager' (6cce81ec-4696-4084-af95-051065764ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2b608a-8fd2-48b1-abfe-0472e6b5ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2b608a-8fd2-48b1-abfe-0472e6b5ae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-308340419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d37c27-00d8-48af-bf2d-62a73e179353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225df189f84143819c61da66687b6539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:16Z,use_quota=True,user_id='6bb8521d079a47b79b45087184692d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429a5052-1d4a-4aba-850d-f5a48107a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429a5052-1d4a-4aba-850d-f5a48107a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e53d430-515e-46a5-876d-56394eeed5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e53d430-515e-46a5-876d-56394eeed5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d37c27-00d8-48af-bf2d-62a73e179353', 'volume_name': 'volume-f0d37c27-00d8-48af-bf2d-62a73e179353', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f4776a-2d2c-4696-81c8-a6f89239c106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f4776a-2d2c-4696-81c8-a6f89239c106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c4f3bf-8a2c-4789-8e94-7451ea2515a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:16 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Volume f0d37c27-00d8-48af-bf2d-62a73e179353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d37c27-00d8-48af-bf2d-62a73e179353', 'volume_size': 1} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:16 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.info" returned: 0 in 0.340s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:16 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:16 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.info Aug 26 03:05:16 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:16 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.info" returned: 0 in 0.341s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.980s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825112580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89f5c1a-3c69-43b4-a802-afda5f23d725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:12Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Creating volume c89f5c1a-3c69-43b4-a802-afda5f23d725 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:16 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:16 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 1073741824 Aug 26 03:05:16 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-89918cf5-59e1-4e41-ad8e-78578a4d909e tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 4151f021-fe50-4f97-b78b-386a50e80cc1: created successfully Aug 26 03:05:17 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 1073741824" returned: 0 in 0.658s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:17 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 Aug 26 03:05:17 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 4151f021-fe50-4f97-b78b-386a50e80cc1: deleting Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 4151f021-fe50-4f97-b78b-386a50e80cc1: deleting {{(pid=93797) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-ea7e4df7-a8d0-426a-84b1-f29620db2035" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-ea7e4df7-a8d0-426a-84b1-f29620db2035" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-0b82acb0-35cc-437d-bba4-411c6a0d59bc" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-0b82acb0-35cc-437d-bba4-411c6a0d59bc" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Deleting offline snapshot 0b82acb0-35cc-437d-bba4-411c6a0d59bc of volume ea7e4df7-a8d0-426a-84b1-f29620db2035 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] snapshot_file for this snap is: volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb4f32-9089-4850-bc61-55c4b4834c3b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:17 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725" returned: 0 in 0.616s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.946s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-308340419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d37c27-00d8-48af-bf2d-62a73e179353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225df189f84143819c61da66687b6539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:16Z,use_quota=True,user_id='6bb8521d079a47b79b45087184692d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Creating volume f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:17 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:18 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc Aug 26 03:05:18 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fa3aa4-ff95-43e4-8180-3f8c2758f96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89f5c1a-3c69-43b4-a802-afda5f23d725', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:18 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 1073741824 Aug 26 03:05:18 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916280e3-7fc8-4637-815f-92eec0929d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:18 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 (c89f5c1a-3c69-43b4-a802-afda5f23d725): created successfully Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916280e3-7fc8-4637-815f-92eec0929d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (b880db14-7957-477e-9066-d5f46d4172b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:18 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-49d643c6-b00a-4321-90bf-64c95c7ef106 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created volume successfully. Aug 26 03:05:18 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc" returned: 0 in 0.611s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea7e4df7-a8d0-426a-84b1-f29620db2035(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eff848-7733-43cf-af46-a0b5b9dd7308]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:18 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 Aug 26 03:05:18 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:18 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 1073741824" returned: 0 in 0.741s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:18 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 Aug 26 03:05:18 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:19 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035" returned: 0 in 0.684s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:19 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc Aug 26 03:05:19 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:19 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353" returned: 0 in 0.469s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.175s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c4f3bf-8a2c-4789-8e94-7451ea2515a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d37c27-00d8-48af-bf2d-62a73e179353', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4165f4-1661-44eb-9ab3-9a3702044d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Creating offline snapshot 2e6c7fc4-4496-47f8-b559-d49c59ca4b23 of volume c89f5c1a-3c69-43b4-a802-afda5f23d725 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:05:19 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Volume volume-f0d37c27-00d8-48af-bf2d-62a73e179353 (f0d37c27-00d8-48af-bf2d-62a73e179353): created successfully Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4165f4-1661-44eb-9ab3-9a3702044d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Flow 'volume_create_manager' (6cce81ec-4696-4084-af95-051065764ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e275ff53-f33b-4614-aef4-22a3c68a809b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-408c945d-2cf7-4ce8-adcd-df3715fe1803 tempest-VolumesCloneTest-124601722 None] Created volume successfully. Aug 26 03:05:19 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 Aug 26 03:05:19 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:19 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc" returned: 0 in 0.527s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:19 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc Aug 26 03:05:19 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:19 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725" returned: 0 in 0.461s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:19 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 1G Aug 26 03:05:19 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:20 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035.0b82acb0-35cc-437d-bba4-411c6a0d59bc" returned: 0 in 0.350s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-0b82acb0-35cc-437d-bba4-411c6a0d59bc" released by "_delete_snapshot" :: held 2.383s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-ea7e4df7-a8d0-426a-84b1-f29620db2035" released by "delete_snapshot" :: held 2.423s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-a60cf9f6-eb4c-49d8-bee7-e2217582b231" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-a60cf9f6-eb4c-49d8-bee7-e2217582b231" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-d9530b0a-cecf-4cfc-8e31-e822400efd2c" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-d9530b0a-cecf-4cfc-8e31-e822400efd2c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Deleting offline snapshot d9530b0a-cecf-4cfc-8e31-e822400efd2c of volume a60cf9f6-eb4c-49d8-bee7-e2217582b231 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] snapshot_file for this snap is: volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[717edfd6-ca0f-42af-b86d-a92446116335]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:20 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c Aug 26 03:05:20 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:20 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 1G" returned: 0 in 0.737s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:20 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 Aug 26 03:05:20 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:20 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c" returned: 0 in 0.742s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed04af48-98d5-4106-84bb-68e9b862791d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:21 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 Aug 26 03:05:21 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:21 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23" returned: 0 in 0.864s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:21 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 is being set with open permissions: ugo+rw Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:21 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 Aug 26 03:05:21 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Flow 'volume_create_manager' (31ad8c9e-a5dd-4945-bef9-bedde502e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1778864e-9805-41fa-94a4-f795393c0800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1778864e-9805-41fa-94a4-f795393c0800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1212873752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9567232-9475-48e3-b8ac-b62e9997c05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225df189f84143819c61da66687b6539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f0d37c27-00d8-48af-bf2d-62a73e179353,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:21Z,use_quota=True,user_id='6bb8521d079a47b79b45087184692d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac4eb97-b5c4-4ed7-8250-9ddf61ddbaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac4eb97-b5c4-4ed7-8250-9ddf61ddbaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0793450-98dd-4317-9231-7f1276283141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0793450-98dd-4317-9231-7f1276283141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd9567232-9475-48e3-b8ac-b62e9997c05c', 'volume_name': 'volume-d9567232-9475-48e3-b8ac-b62e9997c05c', 'volume_size': 2, 'source_volid': 'f0d37c27-00d8-48af-bf2d-62a73e179353', 'source_volstatus': 'available'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39201cad-fe91-4d6b-8444-cfea86b05b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39201cad-fe91-4d6b-8444-cfea86b05b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de77e77a-ebe5-4bc7-a6ff-bf644ba202d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:21 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Volume d9567232-9475-48e3-b8ac-b62e9997c05c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d9567232-9475-48e3-b8ac-b62e9997c05c', 'volume_size': 2, 'source_volid': 'f0d37c27-00d8-48af-bf2d-62a73e179353', 'source_volstatus': 'available'} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:21 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231" returned: 0 in 0.847s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:21 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c Aug 26 03:05:22 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:22 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23" returned: 0 in 0.676s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:22 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.info Aug 26 03:05:22 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:22 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c" returned: 0 in 0.714s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:22 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c Aug 26 03:05:22 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:22 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.info" returned: 0 in 0.478s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:22 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.info is being set with open permissions: ugo+rw Aug 26 03:05:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:22 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.info Aug 26 03:05:22 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:22 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231.d9530b0a-cecf-4cfc-8e31-e822400efd2c" returned: 0 in 0.322s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-d9530b0a-cecf-4cfc-8e31-e822400efd2c" released by "_delete_snapshot" :: held 2.857s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-a60cf9f6-eb4c-49d8-bee7-e2217582b231" released by "delete_snapshot" :: held 2.893s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:23 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.info" returned: 0 in 0.339s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.810s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.270s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:23 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Cloning volume f0d37c27-00d8-48af-bf2d-62a73e179353 to volume d9567232-9475-48e3-b8ac-b62e9997c05c Aug 26 03:05:23 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b514407f-ef29-4bc3-925c-14cf87643557 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Create snapshot completed successfully Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Creating offline snapshot 9c8005bd-13b6-47ab-bfc4-7c68ec155132 of volume f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:05:23 devstack cinder-volume[93797]: WARNING cinder.quota [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1270464528 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1270464528, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:05:23 devstack cinder-volume[93797]: WARNING cinder.quota [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1270464528 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1270464528, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[943a4f5d-6abb-4b30-929b-bf38fbbbcf7c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['ffa53ffe-1e13-4e74-b2da-fb9660e9ba0e', '4e306591-7e1e-44d9-a5fb-34cb3e11d449', '8c7a45a8-e695-4062-9929-39e365a75496', '199c4baf-d29a-4b85-a5dd-4437e5160c39'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:23 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 Aug 26 03:05:23 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['3199500e-4be1-4af0-91ff-db4e13290d32', 'b709b057-bb27-4a9b-8a1c-87fd09d4de9b', 'e0b7e07c-1c23-48f6-af48-08c9cab279bb', '7817bfd9-9997-4412-91e7-f67e4ea655c4'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:23 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:23 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c18cf67d-43f6-40f9-9a15-37d0f2202888 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 4151f021-fe50-4f97-b78b-386a50e80cc1: deleted successfully Aug 26 03:05:24 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353" returned: 0 in 0.860s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:24 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 1G Aug 26 03:05:24 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (72a676b1-991b-41e6-a9d3-e697f66084b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72804b24-6080-47ee-848e-654bdad183ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72804b24-6080-47ee-848e-654bdad183ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386405377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf91fd5-5e86-450c-8341-706cbfe1536b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:24Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cca739-4e36-47f9-b207-1f0ea4451c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cca739-4e36-47f9-b207-1f0ea4451c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae295b5-36df-4531-b6e0-458802fa70e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae295b5-36df-4531-b6e0-458802fa70e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf91fd5-5e86-450c-8341-706cbfe1536b', 'volume_name': 'volume-9cf91fd5-5e86-450c-8341-706cbfe1536b', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fc8f9e-5765-43d9-9c98-c15fc01d59b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fc8f9e-5765-43d9-9c98-c15fc01d59b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41104064-4f05-4fb4-b355-aa90c79df614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:24 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume 9cf91fd5-5e86-450c-8341-706cbfe1536b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf91fd5-5e86-450c-8341-706cbfe1536b', 'volume_size': 1} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-a60cf9f6-eb4c-49d8-bee7-e2217582b231" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-a60cf9f6-eb4c-49d8-bee7-e2217582b231" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c95d70-8d77-49bc-bc92-4a86d71205bc]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:25 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 Aug 26 03:05:25 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (89451424-850f-4848-b92d-bd1ff225f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:25 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddc3814-23f0-4688-ac95-cbc6d4a48814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 1G" returned: 0 in 1.325s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d37c27-00d8-48af-bf2d-62a73e179353 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:25 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d37c27-00d8-48af-bf2d-62a73e179353 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 Aug 26 03:05:25 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddc3814-23f0-4688-ac95-cbc6d4a48814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1245203149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8bd377-274a-47c2-aa99-3632efe45cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:25Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de0c450-383d-46e8-be3c-51628a0c962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de0c450-383d-46e8-be3c-51628a0c962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183de7dc-bfd3-4ceb-9bde-536615e822db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183de7dc-bfd3-4ceb-9bde-536615e822db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8bd377-274a-47c2-aa99-3632efe45cf8', 'volume_name': 'volume-dd8bd377-274a-47c2-aa99-3632efe45cf8', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b01dc7a-d20d-41b1-8296-3f8fd9df9598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b01dc7a-d20d-41b1-8296-3f8fd9df9598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c290f56f-5e38-487e-9ef2-bfd77c9bb579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:25 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume dd8bd377-274a-47c2-aa99-3632efe45cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8bd377-274a-47c2-aa99-3632efe45cf8', 'volume_size': 1} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:25 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231" returned: 0 in 1.118s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:26 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231 Aug 26 03:05:26 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:26 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d37c27-00d8-48af-bf2d-62a73e179353 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132" returned: 0 in 0.948s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:26 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 is being set with open permissions: ugo+rw Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:26 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 Aug 26 03:05:26 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:INSERT=37,cinder:UPDATE=139,cinder:SELECT=139,cinder:DELETE=8 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=136,cinder:INSERT=40,cinder:UPDATE=142,cinder:DELETE=8 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (cf0b2764-84f7-4b76-a898-3a1b5614c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eaa039-f97a-40ad-ba0e-60c25771764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eaa039-f97a-40ad-ba0e-60c25771764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672348883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e04341-8918-449d-9bcd-4e9f01a2a95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:26Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecba4f30-559d-4db6-b91c-2ae6e6b38b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecba4f30-559d-4db6-b91c-2ae6e6b38b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694bbfbd-2fc4-4213-a66f-f472cf44936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694bbfbd-2fc4-4213-a66f-f472cf44936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e04341-8918-449d-9bcd-4e9f01a2a95d', 'volume_name': 'volume-81e04341-8918-449d-9bcd-4e9f01a2a95d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aad1987-d077-4a97-85fc-2ae94144a8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aad1987-d077-4a97-85fc-2ae94144a8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb6dddd-f941-4650-b821-6f8371d2f521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:26 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume 81e04341-8918-449d-9bcd-4e9f01a2a95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e04341-8918-449d-9bcd-4e9f01a2a95d', 'volume_size': 1} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:26 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a60cf9f6-eb4c-49d8-bee7-e2217582b231" returned: 0 in 0.713s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-a60cf9f6-eb4c-49d8-bee7-e2217582b231" released by "delete_volume" :: held 2.008s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-ea7e4df7-a8d0-426a-84b1-f29620db2035" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-ea7e4df7-a8d0-426a-84b1-f29620db2035" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea4f196-a4b2-4b87-b14b-45805642967b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:26 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132" returned: 0 in 0.492s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:26 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.info Aug 26 03:05:26 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:27 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 Aug 26 03:05:27 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (9951b2ab-c23a-4b2e-aabd-d026943c52ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2696090e-4880-4e6d-8881-6f9c65e02adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:27 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035" returned: 0 in 0.845s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:27 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2696090e-4880-4e6d-8881-6f9c65e02adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141609650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe9cee3-2963-4fa7-bdd4-ed5ad924518a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:27Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de0cffd-7a36-4e95-894c-de0aecbd3fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:27 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035 Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de0cffd-7a36-4e95-894c-de0aecbd3fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:27 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae11630-637a-485b-91ba-00af1d77c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae11630-637a-485b-91ba-00af1d77c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe9cee3-2963-4fa7-bdd4-ed5ad924518a', 'volume_name': 'volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5792186-eeff-4865-aad4-24573ccf95ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5792186-eeff-4865-aad4-24573ccf95ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfd74d0-4800-47f4-b5c4-fcdd0d578d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:27 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume cbe9cee3-2963-4fa7-bdd4-ed5ad924518a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a', 'volume_size': 1} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.info" returned: 0 in 0.915s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:27 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.info is being set with open permissions: ugo+rw Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:27 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.info Aug 26 03:05:27 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-68de76a7-2379-48cb-831b-310294f6fe47 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2" by "attach_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-68de76a7-2379-48cb-831b-310294f6fe47 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2" acquired by "attach_volume" :: waited 0.130s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:28 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ea7e4df7-a8d0-426a-84b1-f29620db2035" returned: 0 in 0.510s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-ea7e4df7-a8d0-426a-84b1-f29620db2035" released by "delete_volume" :: held 1.461s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-68de76a7-2379-48cb-831b-310294f6fe47 tempest-VolumesActionsTest-2104509767 None] Attaching volume 7d138324-201e-42e0-b9b4-eea27642b1d2 to instance e006dd1a-3965-4551-9c04-af990d63b8f7 at mountpoint /dev/vdb on host None. Aug 26 03:05:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-68de76a7-2379-48cb-831b-310294f6fe47 tempest-VolumesActionsTest-2104509767 None] Attach volume completed successfully. Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-68de76a7-2379-48cb-831b-310294f6fe47 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2" released by "attach_volume" :: held 0.286s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (c63fc08f-0dc8-4a3f-a7b8-af192f2b2c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405392cf-3eb7-43a0-88a9-2795e3550156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['c49fb42d-84d7-4d11-8ce0-c8ab39abf05b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405392cf-3eb7-43a0-88a9-2795e3550156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115794741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a650f1ba-5843-478a-b41b-eb785d12f75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:28Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:28 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487053cc-ec67-44be-8447-d31f66e64b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487053cc-ec67-44be-8447-d31f66e64b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0d9ba7-5381-41f2-bf1a-57812a256bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0d9ba7-5381-41f2-bf1a-57812a256bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a650f1ba-5843-478a-b41b-eb785d12f75a', 'volume_name': 'volume-a650f1ba-5843-478a-b41b-eb785d12f75a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daecfde2-a95d-4778-a882-d571eab757cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daecfde2-a95d-4778-a882-d571eab757cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7421edd6-5fb9-476c-a3c2-49f3146e1888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume a650f1ba-5843-478a-b41b-eb785d12f75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a650f1ba-5843-478a-b41b-eb785d12f75a', 'volume_size': 1} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.info" returned: 0 in 0.715s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Acquiring lock "cinder-quobyte-d9567232-9475-48e3-b8ac-b62e9997c05c" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Lock "cinder-quobyte-d9567232-9475-48e3-b8ac-b62e9997c05c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] snapshot: 9c8005bd-13b6-47ab-bfc4-7c68ec155132, volume: d9567232-9475-48e3-b8ac-b62e9997c05c, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[57034c33-9b67-4de1-8dec-bb1db03855a8]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d78351dc-770d-4dfb-b85b-82a6976b5fa1 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-detach_volume" by "detach_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:28 devstack cinder-volume[93797]: WARNING cinder.quota [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1270464528 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1270464528, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d78351dc-770d-4dfb-b85b-82a6976b5fa1 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d78351dc-770d-4dfb-b85b-82a6976b5fa1 tempest-VolumesActionsTest-2104509767 None] Detaching volume 7d138324-201e-42e0-b9b4-eea27642b1d2 from instance e006dd1a-3965-4551-9c04-af990d63b8f7. Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['0176c326-b172-4940-9bfd-5acbe14cb15e', '510a0848-fadc-41e4-9411-dab32ee2ad84', 'e3353cef-5f13-48fa-9515-28b2b651b48b', '90e67fc3-a9a1-4c58-95b3-19ee93a51085'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d78351dc-770d-4dfb-b85b-82a6976b5fa1 tempest-VolumesActionsTest-2104509767 None] Detach volume completed successfully. Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d78351dc-770d-4dfb-b85b-82a6976b5fa1 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-detach_volume" released by "detach_volume" :: held 0.140s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:28 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 Aug 26 03:05:28 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:28 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['50b9862f-adc6-48c7-b4f7-04bcc8b48221', 'aa712014-4446-4e57-aff6-3d962f0f420b', 'a0547c29-5d6b-4b0a-b4f1-fd05ca57692b', 'f7712bb6-af76-4da2-afec-22fdf10f0215'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:29 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:29 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:29 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132" returned: 0 in 0.766s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0d37c27-00d8-48af-bf2d-62a73e179353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c424af03-8b5a-4f87-9d82-05d81794572c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:29 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 Aug 26 03:05:29 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:29 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.412s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c3a57f05-e861-4bc0-b0e8-db17a3192050 tempest-GroupSnapshotsTest-1427967407 None] Delete group completed successfully. Aug 26 03:05:29 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353" returned: 0 in 0.568s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:05:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:05:30 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:05:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:30 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c Aug 26 03:05:30 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4c5c8418-1e9d-4563-bc01-c3f00fdf8e57 tempest-GroupSnapshotsTest-1427967407 None] Group tempest-GroupSnapshotsTest-Group-48773087: creating Aug 26 03:05:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4c5c8418-1e9d-4563-bc01-c3f00fdf8e57 tempest-GroupSnapshotsTest-1427967407 None] Group tempest-GroupSnapshotsTest-Group-48773087: created successfully Aug 26 03:05:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4c5c8418-1e9d-4563-bc01-c3f00fdf8e57 tempest-GroupSnapshotsTest-1427967407 None] Create group completed successfully. Aug 26 03:05:33 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Flow 'volume_create_manager' (b63ed999-26c9-47e2-8008-46aaa4639519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784b48f5-b8fb-4980-bbd4-6a2168e2de4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784b48f5-b8fb-4980-bbd4-6a2168e2de4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1147596613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58940a46-c6cc-41a8-b79b-88e948c3d580,host='devstack@QuobyteHD#QuobyteHD',id=054fa32b-4210-4c57-9e7a-51660786ecbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6075004e8a1d4b93a6f63f092881a232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:34Z,use_quota=True,user_id='5e2c58111b41466b802d7165df3a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43968b2e-60dd-4a20-bdc7-a3422a0624f7),volume_type_id=43968b2e-60dd-4a20-bdc7-a3422a0624f7)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39451ac-3166-45e3-a915-1f67d064ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39451ac-3166-45e3-a915-1f67d064ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441084e8-40f4-4d8f-b950-b77631bc23a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441084e8-40f4-4d8f-b950-b77631bc23a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054fa32b-4210-4c57-9e7a-51660786ecbb', 'volume_name': 'volume-054fa32b-4210-4c57-9e7a-51660786ecbb', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2838f7b-30f4-4ea5-8685-71a1a623c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2838f7b-30f4-4ea5-8685-71a1a623c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43a7e0e-3b42-452b-8a8e-8bfed068bd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Volume 054fa32b-4210-4c57-9e7a-51660786ecbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054fa32b-4210-4c57-9e7a-51660786ecbb', 'volume_size': 1} Aug 26 03:05:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:36 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c" returned: 0 in 6.235s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:05:36 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Converted 1024.00 MB image at 164.21 MB/s Aug 26 03:05:36 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c is being set with open permissions: ugo+rw Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:36 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c Aug 26 03:05:36 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:36 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c" returned: 0 in 0.297s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Lock "cinder-quobyte-d9567232-9475-48e3-b8ac-b62e9997c05c" released by "_copy_volume_from_snapshot" :: held 7.979s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Acquiring lock "cinder-quobyte-9c8005bd-13b6-47ab-bfc4-7c68ec155132" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Lock "cinder-quobyte-9c8005bd-13b6-47ab-bfc4-7c68ec155132" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Deleting offline snapshot 9c8005bd-13b6-47ab-bfc4-7c68ec155132 of volume f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] snapshot_file for this snap is: volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[680def21-d10b-4ef6-bf96-006bf0cbf961]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:36 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 Aug 26 03:05:36 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:37 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132" returned: 0 in 0.428s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0d37c27-00d8-48af-bf2d-62a73e179353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:05:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[319035bb-345b-46ed-94cc-021971922e7f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:37 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 Aug 26 03:05:37 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:37 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353" returned: 0 in 0.615s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:37 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 Aug 26 03:05:37 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:38 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132" returned: 0 in 0.375s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:38 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132 Aug 26 03:05:38 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:38 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353.9c8005bd-13b6-47ab-bfc4-7c68ec155132" returned: 0 in 0.297s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Lock "cinder-quobyte-9c8005bd-13b6-47ab-bfc4-7c68ec155132" released by "_delete_snapshot" :: held 1.814s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.360s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.837s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386405377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf91fd5-5e86-450c-8341-706cbfe1536b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:24Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Creating volume 9cf91fd5-5e86-450c-8341-706cbfe1536b {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:38 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:38 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b 1073741824 Aug 26 03:05:38 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de77e77a-ebe5-4bc7-a6ff-bf644ba202d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9567232-9475-48e3-b8ac-b62e9997c05c', 'volume_size': 2, 'source_volid': 'f0d37c27-00d8-48af-bf2d-62a73e179353', 'source_volstatus': 'available'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef74abdc-572f-48e4-bf63-0f8ebb738348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:38 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Volume volume-d9567232-9475-48e3-b8ac-b62e9997c05c (d9567232-9475-48e3-b8ac-b62e9997c05c): created successfully Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef74abdc-572f-48e4-bf63-0f8ebb738348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Flow 'volume_create_manager' (31ad8c9e-a5dd-4945-bef9-bedde502e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:38 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6cf6ceef-94b9-48b9-83f4-710bbb35ba90 tempest-VolumesCloneTest-124601722 None] Created volume successfully. Aug 26 03:05:38 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b 1073741824" returned: 0 in 0.499s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:39 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b Aug 26 03:05:39 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:39 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b" returned: 0 in 0.293s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.707s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1245203149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8bd377-274a-47c2-aa99-3632efe45cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:25Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Creating volume dd8bd377-274a-47c2-aa99-3632efe45cf8 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:39 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:39 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 1073741824 Aug 26 03:05:39 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41104064-4f05-4fb4-b355-aa90c79df614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf91fd5-5e86-450c-8341-706cbfe1536b', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6fecb41-2944-459a-9725-9294edb6b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:39 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume volume-9cf91fd5-5e86-450c-8341-706cbfe1536b (9cf91fd5-5e86-450c-8341-706cbfe1536b): created successfully Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6fecb41-2944-459a-9725-9294edb6b028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (72a676b1-991b-41e6-a9d3-e697f66084b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:39 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-69af7c9a-74b1-469b-96a6-0d39725d0fec tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created volume successfully. Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Acquiring lock "cinder-d9567232-9475-48e3-b8ac-b62e9997c05c-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Lock "cinder-d9567232-9475-48e3-b8ac-b62e9997c05c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Acquiring lock "cinder-quobyte-d9567232-9475-48e3-b8ac-b62e9997c05c" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Lock "cinder-quobyte-d9567232-9475-48e3-b8ac-b62e9997c05c" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbef236-99f6-4933-8a3e-85ea80d6e773]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:39 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c Aug 26 03:05:39 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:39 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 1073741824" returned: 0 in 0.659s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:40 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 Aug 26 03:05:40 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:40 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c" returned: 0 in 0.414s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:40 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c Aug 26 03:05:40 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:40 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8" returned: 0 in 0.285s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.756s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672348883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e04341-8918-449d-9bcd-4e9f01a2a95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:26Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Creating volume 81e04341-8918-449d-9bcd-4e9f01a2a95d {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:40 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c290f56f-5e38-487e-9ef2-bfd77c9bb579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8bd377-274a-47c2-aa99-3632efe45cf8', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:40 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d 1073741824 Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a300fd-ef37-4af7-9fd2-11f398a61b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:40 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:40 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 (dd8bd377-274a-47c2-aa99-3632efe45cf8): created successfully Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a300fd-ef37-4af7-9fd2-11f398a61b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (89451424-850f-4848-b92d-bd1ff225f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:40 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-79aa288c-89ed-4b0d-b540-4b15f9544183 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created volume successfully. Aug 26 03:05:40 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d9567232-9475-48e3-b8ac-b62e9997c05c" returned: 0 in 0.297s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Lock "cinder-quobyte-d9567232-9475-48e3-b8ac-b62e9997c05c" released by "delete_volume" :: held 0.764s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Created reservations ['820aebce-1877-4779-a565-a830e457359c', '84e9ca28-ed18-495c-8fa2-61dbf877d08d', 'b9d5d8bc-1ba9-47c2-9e4a-76640fa35be2', '69c2f3cd-89b1-4428-acdd-34c48dd0c18e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:40 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:40 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:40 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d 1073741824" returned: 0 in 0.637s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Acquiring lock "cinder-f0d37c27-00d8-48af-bf2d-62a73e179353-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Lock "cinder-f0d37c27-00d8-48af-bf2d-62a73e179353-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:41 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.351s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Deleted volume successfully. Aug 26 03:05:41 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d Aug 26 03:05:41 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Acquiring lock "cinder-quobyte-f0d37c27-00d8-48af-bf2d-62a73e179353" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d7ed421-ed33-4b72-a3d8-e1e59d84b9ad tempest-VolumesCloneTest-124601722 None] Lock "cinder-d9567232-9475-48e3-b8ac-b62e9997c05c-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Lock "cinder-quobyte-f0d37c27-00d8-48af-bf2d-62a73e179353" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1d5d32-ab83-4fd1-8f03-9846a5d2d399]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:41 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 Aug 26 03:05:41 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:41 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d" returned: 0 in 0.302s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.586s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141609650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe9cee3-2963-4fa7-bdd4-ed5ad924518a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:27Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Creating volume cbe9cee3-2963-4fa7-bdd4-ed5ad924518a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:41 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb6dddd-f941-4650-b821-6f8371d2f521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e04341-8918-449d-9bcd-4e9f01a2a95d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:41 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a 1073741824 Aug 26 03:05:41 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ec8de0-b0fe-4343-bd81-88714b555899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:41 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume volume-81e04341-8918-449d-9bcd-4e9f01a2a95d (81e04341-8918-449d-9bcd-4e9f01a2a95d): created successfully Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ec8de0-b0fe-4343-bd81-88714b555899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (cf0b2764-84f7-4b76-a898-3a1b5614c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0a242366-ff91-402a-9e3a-e619b651524f tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created volume successfully. Aug 26 03:05:41 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353" returned: 0 in 0.433s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:41 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353 Aug 26 03:05:41 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:41 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:41 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f0d37c27-00d8-48af-bf2d-62a73e179353" returned: 0 in 0.299s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a 1073741824" returned: 0 in 0.560s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Lock "cinder-quobyte-f0d37c27-00d8-48af-bf2d-62a73e179353" released by "delete_volume" :: held 0.821s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:42 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a Aug 26 03:05:42 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Created reservations ['c82c4276-957a-4569-b12a-7a58483391f4', 'd79500e1-3c10-4d8b-8f30-0bf715f9affd', '031837e1-39d2-4862-9b7b-efdff38efd24', '9d6ac0e4-cc52-4628-b438-c07a071b6836'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:42 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:42 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:42 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a" returned: 0 in 0.345s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.862s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115794741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a650f1ba-5843-478a-b41b-eb785d12f75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecf2c23a3744d86917e9f24d5062c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:28Z,use_quota=True,user_id='1698dc3f31844a0f99d2087745715b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Creating volume a650f1ba-5843-478a-b41b-eb785d12f75a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:42 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfd74d0-4800-47f4-b5c4-fcdd0d578d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fdf50d3-2eda-4f0c-9b44-c65d5db5520a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:42 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a 1073741824 Aug 26 03:05:42 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:42 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a (cbe9cee3-2963-4fa7-bdd4-ed5ad924518a): created successfully Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fdf50d3-2eda-4f0c-9b44-c65d5db5520a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (9951b2ab-c23a-4b2e-aabd-d026943c52ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1e81548e-f1f5-4884-b476-8ed4a4b2187c tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created volume successfully. Aug 26 03:05:42 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Deleted volume successfully. Aug 26 03:05:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c8e5cbd-6b47-415f-866f-2501f3ba9cc2 tempest-VolumesCloneTest-124601722 None] Lock "cinder-f0d37c27-00d8-48af-bf2d-62a73e179353-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:43 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a 1073741824" returned: 0 in 0.637s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:43 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a Aug 26 03:05:43 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:43 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.129s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58940a46-c6cc-41a8-b79b-88e948c3d580,created_at=2026-08-26T01:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1147596613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58940a46-c6cc-41a8-b79b-88e948c3d580,host='devstack@QuobyteHD#QuobyteHD',id=054fa32b-4210-4c57-9e7a-51660786ecbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6075004e8a1d4b93a6f63f092881a232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:34Z,use_quota=True,user_id='5e2c58111b41466b802d7165df3a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43968b2e-60dd-4a20-bdc7-a3422a0624f7),volume_type_id=43968b2e-60dd-4a20-bdc7-a3422a0624f7)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Creating volume 054fa32b-4210-4c57-9e7a-51660786ecbb {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:43 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7421edd6-5fb9-476c-a3c2-49f3146e1888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a650f1ba-5843-478a-b41b-eb785d12f75a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:43 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb 1073741824 Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38539df-9a6d-492c-a244-9cb7be130bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:43 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:43 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Volume volume-a650f1ba-5843-478a-b41b-eb785d12f75a (a650f1ba-5843-478a-b41b-eb785d12f75a): created successfully Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38539df-9a6d-492c-a244-9cb7be130bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Flow 'volume_create_manager' (c63fc08f-0dc8-4a3f-a7b8-af192f2b2c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:43 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1b056dc2-20c3-4ba4-a121-7b3ded2b1954 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created volume successfully. Aug 26 03:05:43 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb 1073741824" returned: 0 in 0.550s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:44 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb Aug 26 03:05:44 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:44 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb" returned: 0 in 0.287s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.529s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43a7e0e-3b42-452b-8a8e-8bfed068bd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054fa32b-4210-4c57-9e7a-51660786ecbb', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86fa32d-2c56-4447-8ec3-a3424d049819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e08695-16cb-4d68-8c9b-0f6f46642af5]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:44 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Volume volume-054fa32b-4210-4c57-9e7a-51660786ecbb (054fa32b-4210-4c57-9e7a-51660786ecbb): created successfully Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86fa32d-2c56-4447-8ec3-a3424d049819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Flow 'volume_create_manager' (b63ed999-26c9-47e2-8008-46aaa4639519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:44 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-551a7454-9850-4775-b1a4-251f70f3ec68 tempest-GroupSnapshotsTest-1427967407 None] Created volume successfully. Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-a650f1ba-5843-478a-b41b-eb785d12f75a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-a650f1ba-5843-478a-b41b-eb785d12f75a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:44 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:05:44 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-quobyte-a650f1ba-5843-478a-b41b-eb785d12f75a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-a650f1ba-5843-478a-b41b-eb785d12f75a" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bb207e-c135-4220-a3ee-e16fbfc99f67]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:44 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a Aug 26 03:05:44 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:44 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.514s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[af68c92f-a334-46f4-93bb-426f670530f1]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:45 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:05:45 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:45 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a" returned: 0 in 0.480s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:45 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a Aug 26 03:05:45 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:45 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.443s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.db78a092-0e16-4515-9eae-69c61125a0a1h76oj7i_.img {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:45 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.db78a092-0e16-4515-9eae-69c61125a0a1h76oj7i_.img Aug 26 03:05:45 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:45 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a650f1ba-5843-478a-b41b-eb785d12f75a" returned: 0 in 0.312s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-a650f1ba-5843-478a-b41b-eb785d12f75a" released by "delete_volume" :: held 0.850s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created reservations ['0f1d240b-06d1-46f7-a04b-b4cccecb2ee5', '80e2f5cb-99ea-4cb8-ae0c-1b801e2fdb0b', '54fda176-9626-45ec-bfbf-ed5a2092bd09', '7f86363a-e757-4399-980e-10b22d104f33'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:45 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:45 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:46 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.721s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Deleted volume successfully. Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-353d503d-6f62-4654-a5d8-094f62b9c051 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-a650f1ba-5843-478a-b41b-eb785d12f75a-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-quobyte-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] GroupSnapshot 7b36fbfb-154e-43d1-8462-5ad55f58e779: creating. Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a" acquired by "delete_volume" :: waited 0.088s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Group snapshot 7b36fbfb-154e-43d1-8462-5ad55f58e779: creating. {{(pid=93797) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56893d4-3895-4146-bce5-627ff7e67cce]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:46 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Flow 'volume_create_manager' (d5fd38c6-6786-49a4-8b8a-0ce311b5dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c81b57-e470-4002-96e0-749d04484b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c81b57-e470-4002-96e0-749d04484b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-768079608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd35235-b452-4347-b2f3-710d1b432dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6fecdc728c45d190295caf3472c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:47Z,use_quota=True,user_id='54a444d9dbcd4bf2966c0ddb5fbef427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610751f7-163e-42fe-a2f0-450ce7c977be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610751f7-163e-42fe-a2f0-450ce7c977be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75eefcce-eaea-4ce1-8d2d-dbca2878bb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75eefcce-eaea-4ce1-8d2d-dbca2878bb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd35235-b452-4347-b2f3-710d1b432dff', 'volume_name': 'volume-afd35235-b452-4347-b2f3-710d1b432dff', 'volume_size': 2}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29a5de9-9194-4dc6-bf99-20b2f569289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29a5de9-9194-4dc6-bf99-20b2f569289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c65a01-ab87-4791-85c0-927193293338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Volume afd35235-b452-4347-b2f3-710d1b432dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd35235-b452-4347-b2f3-710d1b432dff', 'volume_size': 2} Aug 26 03:05:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:47 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a Aug 26 03:05:47 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:48 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a" returned: 0 in 1.138s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:48 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a Aug 26 03:05:48 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:48 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a" returned: 0 in 0.651s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a" released by "delete_volume" :: held 1.940s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:48 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created reservations ['df0565a6-db22-4d9a-8ecf-2fe26038bc02', '858446ab-3cc0-4f21-8bf8-54d0a9ef7cd0', '089b3aed-1abb-4295-a0fe-d43b83790568', '280434e3-a8f3-4488-9938-fef370fff50d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:49 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:49 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-81e04341-8918-449d-9bcd-4e9f01a2a95d-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-81e04341-8918-449d-9bcd-4e9f01a2a95d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-quobyte-81e04341-8918-449d-9bcd-4e9f01a2a95d" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-81e04341-8918-449d-9bcd-4e9f01a2a95d" acquired by "delete_volume" :: waited 0.043s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:49 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.692s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbdc203-8deb-4ba0-a3d9-b77982a1bd35]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Deleted volume successfully. Aug 26 03:05:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4253169-f825-421a-8f33-362f17daf06a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-cbe9cee3-2963-4fa7-bdd4-ed5ad924518a-delete_volume" released by "delete_volume" :: held 3.447s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:50 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d Aug 26 03:05:50 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:50 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d" returned: 0 in 0.804s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:50 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d Aug 26 03:05:50 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:51 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-81e04341-8918-449d-9bcd-4e9f01a2a95d" returned: 0 in 0.587s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:51 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-81e04341-8918-449d-9bcd-4e9f01a2a95d" released by "delete_volume" :: held 1.505s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.db78a092-0e16-4515-9eae-69c61125a0a1h76oj7i_.img" returned: 0 in 5.898s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65a1b80-6bbd-40ee-b70d-83d2aa0a0756]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created reservations ['eebc4289-0077-4e7c-bf91-16acec5a1f25', '9a2d19f5-acae-4e4f-a26f-196dcd6f2aae', '4b09e9cf-abcc-4c8d-92ce-8e5f47a9751c', '9a384914-571a-4fae-b6be-01c6d2013a6c'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:51 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:05:51 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:51 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:51 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:51 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.283s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:51 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Deleted volume successfully. Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b1c7054b-6c38-4563-8e27-65d458005ffd tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-81e04341-8918-449d-9bcd-4e9f01a2a95d-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:51 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.569s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.db78a092-0e16-4515-9eae-69c61125a0a1h76oj7i_.img {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:05:51 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Converted 1024.00 MB image at 173.58 MB/s Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] db78a092-0e16-4515-9eae-69c61125a0a1 was raw, no need to convert to raw {{(pid=93797) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-dd8bd377-274a-47c2-aa99-3632efe45cf8-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-dd8bd377-274a-47c2-aa99-3632efe45cf8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-quobyte-dd8bd377-274a-47c2-aa99-3632efe45cf8" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-dd8bd377-274a-47c2-aa99-3632efe45cf8" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5b18a5-76f3-4e91-8941-7ac7511861a0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:52 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 Aug 26 03:05:52 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:52 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8" returned: 0 in 0.418s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:52 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8 Aug 26 03:05:52 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:52 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dd8bd377-274a-47c2-aa99-3632efe45cf8" returned: 0 in 0.266s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-dd8bd377-274a-47c2-aa99-3632efe45cf8" released by "delete_volume" :: held 0.725s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created reservations ['30015cd6-68fe-43ca-9f71-ddb39852dfcd', '73f90637-b350-481b-86b2-245d9ee7bc4f', '95676445-c6ba-45c4-8329-7196fb9b6d4a', '20bfe8fb-21fc-4341-976b-04cff569dcee'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:52 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:52 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-9cf91fd5-5e86-450c-8341-706cbfe1536b-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-9cf91fd5-5e86-450c-8341-706cbfe1536b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:53 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-quobyte-9cf91fd5-5e86-450c-8341-706cbfe1536b" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Deleted volume successfully. Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-9cf91fd5-5e86-450c-8341-706cbfe1536b" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3de58bd7-8ca9-4089-a348-4c4b1ece452a tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-dd8bd377-274a-47c2-aa99-3632efe45cf8-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a8ea7a-f9d1-4439-bfd4-7777bcbcb5b7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:53 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b Aug 26 03:05:53 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:53 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b" returned: 0 in 0.474s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:53 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b Aug 26 03:05:53 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:54 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf91fd5-5e86-450c-8341-706cbfe1536b" returned: 0 in 0.281s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-9cf91fd5-5e86-450c-8341-706cbfe1536b" released by "delete_volume" :: held 0.804s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created reservations ['f50d16e0-64e3-451c-9c4f-e447e723cf56', '73d50a9e-c3c9-48eb-b781-f81bf83d4efc', '6387f94d-5f8a-4ee9-93e8-ebc3d316741c', '197d1622-e0d7-4b8c-9949-c7bd6ed8fdd0'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:54 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:54 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-2e6c7fc4-4496-47f8-b559-d49c59ca4b23-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-2e6c7fc4-4496-47f8-b559-d49c59ca4b23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-quobyte-c89f5c1a-3c69-43b4-a802-afda5f23d725" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-c89f5c1a-3c69-43b4-a802-afda5f23d725" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-quobyte-2e6c7fc4-4496-47f8-b559-d49c59ca4b23" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-2e6c7fc4-4496-47f8-b559-d49c59ca4b23" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Deleting offline snapshot 2e6c7fc4-4496-47f8-b559-d49c59ca4b23 of volume c89f5c1a-3c69-43b4-a802-afda5f23d725 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] snapshot_file for this snap is: volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7503fc1-b32a-423f-84c6-2c03990a5076]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:54 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.356s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Deleted volume successfully. Aug 26 03:05:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac2fd462-abbf-4da4-abab-213901f2a968 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-9cf91fd5-5e86-450c-8341-706cbfe1536b-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:54 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 Aug 26 03:05:54 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:55 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23" returned: 0 in 0.435s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c89f5c1a-3c69-43b4-a802-afda5f23d725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:05:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf45db0-e189-41ee-8412-bfea725d3e78]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:55 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 Aug 26 03:05:55 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:55 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725" returned: 0 in 0.522s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:55 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 Aug 26 03:05:55 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:56 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23" returned: 0 in 0.443s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:56 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23 Aug 26 03:05:56 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:56 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725.2e6c7fc4-4496-47f8-b559-d49c59ca4b23" returned: 0 in 0.341s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-2e6c7fc4-4496-47f8-b559-d49c59ca4b23" released by "_delete_snapshot" :: held 1.913s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-c89f5c1a-3c69-43b4-a802-afda5f23d725" released by "delete_snapshot" :: held 1.962s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:56 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created reservations ['49c31077-c372-461b-a331-cd5c21e8e8c9', '46419418-3c69-4678-8fb8-0cb362b084c5', '68ef9833-a297-4324-b0f6-7f23b6055da9', '7512eb94-bf81-48dd-9de1-2f1b0e6db5a1'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Delete snapshot completed successfully. Aug 26 03:05:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b5569bbe-206b-47c4-998d-43d1fc1ee507 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-2e6c7fc4-4496-47f8-b559-d49c59ca4b23-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-c89f5c1a-3c69-43b4-a802-afda5f23d725-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-c89f5c1a-3c69-43b4-a802-afda5f23d725-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "cinder-quobyte-c89f5c1a-3c69-43b4-a802-afda5f23d725" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-c89f5c1a-3c69-43b4-a802-afda5f23d725" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:57 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fafcad-bb92-4ce5-95a6-d1b3ee5cfe2b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:58 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 Aug 26 03:05:58 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:58 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725" returned: 0 in 0.452s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:58 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725 Aug 26 03:05:58 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:58 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c89f5c1a-3c69-43b4-a802-afda5f23d725" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-quobyte-c89f5c1a-3c69-43b4-a802-afda5f23d725" released by "delete_volume" :: held 0.848s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Created reservations ['ffe57b4d-429f-4b68-97af-79aceb1a0469', '86ecae64-415e-46d7-b2c8-d23aa2fabc05', 'bf4a54bd-2025-4a0c-a29b-7bbe605a0504', '2a2209fb-e4f6-4cb2-acc0-3bcd85a4926b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:59 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:05:59 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:59 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.333s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:59 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Deleted volume successfully. Aug 26 03:05:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-87d85411-4e1f-4026-b2d7-f22483e08040 tempest-CreateVolumesFromSnapshotTest-1418791957 None] Lock "cinder-c89f5c1a-3c69-43b4-a802-afda5f23d725-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:06:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:02 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:02 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:02 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.518s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:06:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:06:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Flow 'volume_create_manager' (2ec255bd-ec3e-4057-b3f2-beba6121faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b96133-bf49-493a-bb1e-178f7e3930f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b96133-bf49-493a-bb1e-178f7e3930f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850aabb3-243f-4dad-96e9-557d13ef3d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034cfbb8fb8b43e3bccf6b6ff02feace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:05Z,use_quota=True,user_id='7ee015cef804471887643b8cb23d8038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b4cb45-b4ef-407e-a8cf-2bb881e9acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b4cb45-b4ef-407e-a8cf-2bb881e9acfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f80a962-1ce6-4d2c-bd62-4a931dda470f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f80a962-1ce6-4d2c-bd62-4a931dda470f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850aabb3-243f-4dad-96e9-557d13ef3d67', 'volume_name': 'volume-850aabb3-243f-4dad-96e9-557d13ef3d67', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699fcdc1-4ab5-46bb-8961-7f532d393467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699fcdc1-4ab5-46bb-8961-7f532d393467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e68f02c-a537-4cf3-b7a7-8965902cc461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:05 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Volume 850aabb3-243f-4dad-96e9-557d13ef3d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850aabb3-243f-4dad-96e9-557d13ef3d67', 'volume_size': 1} Aug 26 03:06:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=80,cinder:UPDATE=114,cinder:INSERT=28,cinder:DELETE=10 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:06:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.849s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Uploaded volume to glance image-id: db78a092-0e16-4515-9eae-69c61125a0a1. {{(pid=93797) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 03:06:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 26.239s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Creating offline snapshot ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 of volume 054fa32b-4210-4c57-9e7a-51660786ecbb {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:06:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-71485d4a-c836-4358-a730-b4c63b8ed5c8 tempest-VolumesActionsTest-2104509767 None] Copy volume to image completed successfully. Aug 26 03:06:13 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae862273-ef66-4985-97dd-c715ffcc7f50]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:13 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb Aug 26 03:06:13 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:13 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb" returned: 0 in 0.452s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:13 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 1G Aug 26 03:06:13 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:14 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 1G" returned: 0 in 0.553s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054fa32b-4210-4c57-9e7a-51660786ecbb -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:14 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054fa32b-4210-4c57-9e7a-51660786ecbb -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 Aug 26 03:06:14 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:14 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054fa32b-4210-4c57-9e7a-51660786ecbb -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120" returned: 0 in 0.424s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:14 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:06:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:14 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 Aug 26 03:06:14 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:14 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120" returned: 0 in 0.324s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:15 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.info Aug 26 03:06:15 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:15 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.info" returned: 0 in 0.339s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:15 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:15 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.info Aug 26 03:06:15 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:15 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.info" returned: 0 in 0.323s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.495s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-768079608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd35235-b452-4347-b2f3-710d1b432dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6fecdc728c45d190295caf3472c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:47Z,use_quota=True,user_id='54a444d9dbcd4bf2966c0ddb5fbef427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Creating volume afd35235-b452-4347-b2f3-710d1b432dff {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:15 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:06:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff 2147483648 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:15 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff 2147483648 Aug 26 03:06:15 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4d3ad094-16e0-4d45-9a16-ca01928da6f0 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 7b36fbfb-154e-43d1-8462-5ad55f58e779: created successfully Aug 26 03:06:16 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff 2147483648" returned: 0 in 0.594s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:16 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff Aug 26 03:06:16 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 7b36fbfb-154e-43d1-8462-5ad55f58e779: deleting Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 7b36fbfb-154e-43d1-8462-5ad55f58e779: deleting {{(pid=93797) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-054fa32b-4210-4c57-9e7a-51660786ecbb" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:16 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff" returned: 0 in 0.310s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-054fa32b-4210-4c57-9e7a-51660786ecbb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-ebf9b07d-1c4f-4b9a-86ef-555eb66d0120" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.317s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850aabb3-243f-4dad-96e9-557d13ef3d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034cfbb8fb8b43e3bccf6b6ff02feace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:05Z,use_quota=True,user_id='7ee015cef804471887643b8cb23d8038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Creating volume 850aabb3-243f-4dad-96e9-557d13ef3d67 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:16 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:16 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 1073741824 Aug 26 03:06:16 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c65a01-ab87-4791-85c0-927193293338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd35235-b452-4347-b2f3-710d1b432dff', 'volume_size': 2}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f154c186-8aef-4a0b-91cf-89955396a46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-ebf9b07d-1c4f-4b9a-86ef-555eb66d0120" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Deleting offline snapshot ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 of volume 054fa32b-4210-4c57-9e7a-51660786ecbb {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] snapshot_file for this snap is: volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:06:16 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Volume volume-afd35235-b452-4347-b2f3-710d1b432dff (afd35235-b452-4347-b2f3-710d1b432dff): created successfully Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f154c186-8aef-4a0b-91cf-89955396a46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Flow 'volume_create_manager' (d5fd38c6-6786-49a4-8b8a-0ce311b5dffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc89ba6e-21b0-429a-8a19-aa6fa9d64a9a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8e77a524-7ef7-486d-b481-4f041661e017 tempest-VolumesCloneNegativeTest-2027924540 None] Created volume successfully. Aug 26 03:06:16 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 Aug 26 03:06:16 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:17 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 1073741824" returned: 0 in 0.593s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:17 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120" returned: 0 in 0.525s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-054fa32b-4210-4c57-9e7a-51660786ecbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:06:17 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 Aug 26 03:06:17 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[83db3270-95c7-4166-93dc-cdaa456541cf]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:17 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb Aug 26 03:06:17 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:17 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Acquiring lock "cinder-afd35235-b452-4347-b2f3-710d1b432dff-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67" returned: 0 in 0.362s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.950s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "cinder-afd35235-b452-4347-b2f3-710d1b432dff-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e68f02c-a537-4cf3-b7a7-8965902cc461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850aabb3-243f-4dad-96e9-557d13ef3d67', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a6d65d-2474-4b74-bf5f-e665c27e1b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d33a600-b358-4184-8737-de3441846023]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:17 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Volume volume-850aabb3-243f-4dad-96e9-557d13ef3d67 (850aabb3-243f-4dad-96e9-557d13ef3d67): created successfully Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a6d65d-2474-4b74-bf5f-e665c27e1b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Flow 'volume_create_manager' (2ec255bd-ec3e-4057-b3f2-beba6121faae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-87072deb-cf93-4170-bd19-816abee0c7b6 tempest-CinderUnicodeTest-239262069 None] Created volume successfully. Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Acquiring lock "cinder-quobyte-afd35235-b452-4347-b2f3-710d1b432dff" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "cinder-quobyte-afd35235-b452-4347-b2f3-710d1b432dff" acquired by "delete_volume" :: waited 0.062s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:17 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:06:17 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a20d217-c16e-4ce1-8c2b-19ef8b09cf3f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:18 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb" returned: 0 in 0.651s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:18 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 Aug 26 03:06:18 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:18 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff Aug 26 03:06:18 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:18 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.560s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a26d2d1-51e0-4f66-a4e2-d2d2b426ae0a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:18 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:06:18 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:18 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120" returned: 0 in 0.489s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:18 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff" returned: 0 in 0.543s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:18 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120 Aug 26 03:06:18 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:18 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff Aug 26 03:06:18 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:18 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb.ebf9b07d-1c4f-4b9a-86ef-555eb66d0120" returned: 0 in 0.327s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-ebf9b07d-1c4f-4b9a-86ef-555eb66d0120" released by "_delete_snapshot" :: held 2.170s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-054fa32b-4210-4c57-9e7a-51660786ecbb" released by "delete_snapshot" :: held 2.263s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:18 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.624s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:18 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-afd35235-b452-4347-b2f3-710d1b432dff" returned: 0 in 0.445s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:18 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img Aug 26 03:06:18 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Flow 'volume_create_manager' (caffcbce-c51e-449c-a39d-a7150feb8264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fe1377-a769-442b-a255-0e0154428acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "cinder-quobyte-afd35235-b452-4347-b2f3-710d1b432dff" released by "delete_volume" :: held 1.122s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fe1377-a769-442b-a255-0e0154428acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1183546048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08da84b-a39a-4101-b8b2-9fbf8e11029b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034cfbb8fb8b43e3bccf6b6ff02feace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:19Z,use_quota=True,user_id='7ee015cef804471887643b8cb23d8038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a83990e-2805-4a69-bfe2-6b1964fa31b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a83990e-2805-4a69-bfe2-6b1964fa31b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78124800-96fa-4676-97fb-43755d0f6000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78124800-96fa-4676-97fb-43755d0f6000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08da84b-a39a-4101-b8b2-9fbf8e11029b', 'volume_name': 'volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099d2401-1070-4f66-a159-8481960d0558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099d2401-1070-4f66-a159-8481960d0558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c763059-c118-46c2-8b09-1058fbbb29f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:19 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Volume b08da84b-a39a-4101-b8b2-9fbf8e11029b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b', 'volume_size': 1} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:19 devstack cinder-volume[93797]: WARNING cinder.quota [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-858017640 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-858017640, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:06:19 devstack cinder-volume[93797]: WARNING cinder.quota [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-858017640 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-858017640, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Created reservations ['848a4268-3564-4412-8df2-fa97ddce3bba', '13db5d4e-4c8e-4e95-971c-84f8033df0dd', 'ab66b43b-3f15-4d07-b6f0-7bb976c7e53d', '3384bd9e-e0ad-4531-b7d1-acf1b03a6359'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['a9b3eb3f-e713-4f26-8e0c-aaca117b157a', '24a5d6ef-4c7b-4637-8dac-d4bba0aadb14', '0c1e09e8-f679-4d20-947b-49b68f885817', '3b1a9d97-c796-4345-af98-7612812290a3'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:19 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:19 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-004dbae1-f633-451b-92bb-d52a34f94b02 tempest-GroupSnapshotsTest-1427967407 None] group_snapshot 7b36fbfb-154e-43d1-8462-5ad55f58e779: deleted successfully Aug 26 03:06:19 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.400s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Deleted volume successfully. Aug 26 03:06:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f4f9a08f-03a3-41fa-9461-2adb63427c00 tempest-VolumesCloneNegativeTest-2027924540 None] Lock "cinder-afd35235-b452-4347-b2f3-710d1b432dff-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "cinder-quobyte-054fa32b-4210-4c57-9e7a-51660786ecbb" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-054fa32b-4210-4c57-9e7a-51660786ecbb" acquired by "delete_volume" :: waited 0.051s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e8e4b-68ef-44d5-a3d6-67abda9069a4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:22 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb Aug 26 03:06:22 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:23 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb" returned: 0 in 1.490s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:23 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb Aug 26 03:06:23 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:24 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-054fa32b-4210-4c57-9e7a-51660786ecbb" returned: 0 in 1.034s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Lock "cinder-quobyte-054fa32b-4210-4c57-9e7a-51660786ecbb" released by "delete_volume" :: held 2.727s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:24 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['15f497fe-d8dc-4087-9d0f-abbd53608656'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:24 devstack cinder-volume[93797]: WARNING cinder.quota [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-858017640 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-858017640, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:06:24 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Created reservations ['48d0d909-be73-436f-bb1a-7fdc1421c8b2', '0a7d138f-5658-4eca-b5a8-787fb609c239', 'a580131e-6bd4-4e16-af0e-2471dac15e55', 'acf34775-625f-45ca-bece-4d6893639a05'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:24 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img" returned: 0 in 6.028s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:24 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[700cc5e2-1715-4648-8928-129ee42867ef]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:25 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:25 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:25 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:06:25 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:25 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.354s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:25 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5d9832c0-6282-4817-be66-4bcab009f8a8 tempest-GroupSnapshotsTest-1427967407 None] Delete group completed successfully. Aug 26 03:06:25 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.664s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:06:25 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Converted 1024.00 MB image at 169.83 MB/s Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] 5feac4c7-18fc-459a-a2af-d1fab90590f4 was raw, converting to qcow2 {{(pid=93797) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c19098-772f-41ed-a3a7-b488dc837e3c]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:25 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img Aug 26 03:06:25 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:26 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img" returned: 0 in 0.434s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:26 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img Aug 26 03:06:26 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:26 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img" returned: 1 in 0.434s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img /opt/stack/data/cinder/conversion/vol_upload_g7sk_hxx {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:26 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img /opt/stack/data/cinder/conversion/vol_upload_g7sk_hxx Aug 26 03:06:26 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:26 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img /opt/stack/data/cinder/conversion/vol_upload_g7sk_hxx" returned: 0 in 0.304s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Image conversion details: src /opt/stack/data/cinder/conversion/7d138324-201e-42e0-b9b4-eea27642b1d2.temp_image.5feac4c7-18fc-459a-a2af-d1fab90590f47elphx9k.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_g7sk_hxx {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:06:26 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4918ee9-7679-4d02-a6e9-9440a4793932]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g7sk_hxx {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:27 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g7sk_hxx Aug 26 03:06:27 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:27 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g7sk_hxx" returned: 0 in 0.461s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=116,cinder:UPDATE=149,cinder:INSERT=36,cinder:DELETE=5 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (8d464caf-cc12-4874-9f12-3dbf46e1165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693b92fa-e4af-43c0-aca6-6e1c7dee3850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693b92fa-e4af-43c0-aca6-6e1c7dee3850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1355835549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83acc02d-bfeb-4f32-88e8-01a541e674eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:28Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6b72fe-77db-4143-a282-375c7aaf6263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6b72fe-77db-4143-a282-375c7aaf6263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c6fa1d-94b4-4132-a040-719358fc1aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c6fa1d-94b4-4132-a040-719358fc1aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83acc02d-bfeb-4f32-88e8-01a541e674eb', 'volume_name': 'volume-83acc02d-bfeb-4f32-88e8-01a541e674eb', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47a367b-fd9f-4706-8066-92cdcbb4f499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47a367b-fd9f-4706-8066-92cdcbb4f499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09522de0-b93c-44ac-b725-3f3126a6a051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:27 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Volume 83acc02d-bfeb-4f32-88e8-01a541e674eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83acc02d-bfeb-4f32-88e8-01a541e674eb', 'volume_size': 1} Aug 26 03:06:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.544s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Uploaded volume to glance image-id: 5feac4c7-18fc-459a-a2af-d1fab90590f4. {{(pid=93797) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.109s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1183546048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08da84b-a39a-4101-b8b2-9fbf8e11029b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034cfbb8fb8b43e3bccf6b6ff02feace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:19Z,use_quota=True,user_id='7ee015cef804471887643b8cb23d8038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Creating volume b08da84b-a39a-4101-b8b2-9fbf8e11029b {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:29 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:29 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b 1073741824 Aug 26 03:06:29 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5d2c2427-d266-4a3f-a3e9-1f5ce54f1110 tempest-VolumesActionsTest-2104509767 None] Copy volume to image completed successfully. Aug 26 03:06:29 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b 1073741824" returned: 0 in 0.590s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:29 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b Aug 26 03:06:29 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:30 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b" returned: 0 in 0.311s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.531s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1355835549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83acc02d-bfeb-4f32-88e8-01a541e674eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:28Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Creating volume 83acc02d-bfeb-4f32-88e8-01a541e674eb {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:30 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c763059-c118-46c2-8b09-1058fbbb29f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb12e2d6-4b54-47ea-8bc1-72889cd71977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:30 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb 1073741824 Aug 26 03:06:30 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Volume volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b (b08da84b-a39a-4101-b8b2-9fbf8e11029b): created successfully Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb12e2d6-4b54-47ea-8bc1-72889cd71977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Flow 'volume_create_manager' (caffcbce-c51e-449c-a39d-a7150feb8264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6291a8be-8718-49c8-b40b-1f1267e1449d tempest-CinderUnicodeTest-239262069 None] Created volume successfully. Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "cinder-quobyte-7d138324-201e-42e0-b9b4-eea27642b1d2" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-quobyte-7d138324-201e-42e0-b9b4-eea27642b1d2" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fed41c-12e0-449a-92f9-46516382d27e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:30 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:06:30 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:31 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb 1073741824" returned: 0 in 0.758s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:31 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb Aug 26 03:06:31 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:31 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.471s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:31 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2 Aug 26 03:06:31 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:31 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb" returned: 0 in 0.314s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09522de0-b93c-44ac-b725-3f3126a6a051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83acc02d-bfeb-4f32-88e8-01a541e674eb', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1cee16-2596-4ae8-9a77-c49e7a9195a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Volume volume-83acc02d-bfeb-4f32-88e8-01a541e674eb (83acc02d-bfeb-4f32-88e8-01a541e674eb): created successfully Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1cee16-2596-4ae8-9a77-c49e7a9195a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (8d464caf-cc12-4874-9f12-3dbf46e1165c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7f54d63b-fb15-4af8-b019-4eef7732b7d5 tempest-VolumesGetTest-1050414135 None] Created volume successfully. Aug 26 03:06:31 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7d138324-201e-42e0-b9b4-eea27642b1d2" returned: 0 in 0.307s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-quobyte-7d138324-201e-42e0-b9b4-eea27642b1d2" released by "delete_volume" :: held 0.826s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Created reservations ['0f3c79bf-9b3c-4410-b66b-250cdc498cc8', 'a7dafe38-28f6-49ae-b314-42d5d2e9dd31', 'c42ee0e3-118c-474d-a408-762f167a35ae', '6fd9402a-c20f-45ef-9ea3-c2f429db99a7'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:31 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:31 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Creating offline snapshot 4d0fc511-a703-4bdd-8878-11b63ba7939c of volume b08da84b-a39a-4101-b8b2-9fbf8e11029b {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd591fb-6eb9-4784-a232-0614fbc0cf38]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:32 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b Aug 26 03:06:32 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:32 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.593s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Deleted volume successfully. Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-409e8b79-610e-447a-aed1-498dd165f671 tempest-VolumesActionsTest-2104509767 None] Lock "cinder-7d138324-201e-42e0-b9b4-eea27642b1d2-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:32 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b" returned: 0 in 0.635s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:32 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c 1G Aug 26 03:06:32 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (509a3670-b79a-4098-b408-958694e909d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6144a5f-930d-45c1-abe1-d928fbb690ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6144a5f-930d-45c1-abe1-d928fbb690ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-218076310',display_name='tempest-VolumesGetTest-Volume-1761471854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8939409f-6f9b-4341-a389-cb3d10fec947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:33Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b782f47c-83d5-4be8-945c-575b944c1637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b782f47c-83d5-4be8-945c-575b944c1637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230c815d-b748-481d-8dc6-51169a9f6949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230c815d-b748-481d-8dc6-51169a9f6949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8939409f-6f9b-4341-a389-cb3d10fec947', 'volume_name': 'volume-8939409f-6f9b-4341-a389-cb3d10fec947', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5112a0af-c17f-49ac-94d2-26173e78dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5112a0af-c17f-49ac-94d2-26173e78dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761d5091-e50d-487f-8ecb-05093c4fc738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:33 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Volume 8939409f-6f9b-4341-a389-cb3d10fec947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8939409f-6f9b-4341-a389-cb3d10fec947', 'volume_size': 1} Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-321fd743-6fbc-4e52-8748-b3fb24982536 tempest-GroupsV314Test-769418447 None] Group tempest-GroupsV314Test-Group-150115028: creating Aug 26 03:06:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-321fd743-6fbc-4e52-8748-b3fb24982536 tempest-GroupsV314Test-769418447 None] Group tempest-GroupsV314Test-Group-150115028: created successfully Aug 26 03:06:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-321fd743-6fbc-4e52-8748-b3fb24982536 tempest-GroupsV314Test-769418447 None] Create group completed successfully. Aug 26 03:06:33 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c 1G" returned: 0 in 0.661s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:33 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c Aug 26 03:06:33 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:33 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c" returned: 0 in 0.355s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:33 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c is being set with open permissions: ugo+rw Aug 26 03:06:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:33 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c Aug 26 03:06:33 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:34 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c" returned: 0 in 0.291s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:34 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.info Aug 26 03:06:34 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:34 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.info" returned: 0 in 0.308s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:34 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.info is being set with open permissions: ugo+rw Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:34 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.info Aug 26 03:06:34 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:34 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.info" returned: 0 in 0.387s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-218076310',display_name='tempest-VolumesGetTest-Volume-1761471854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8939409f-6f9b-4341-a389-cb3d10fec947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:33Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Creating volume 8939409f-6f9b-4341-a389-cb3d10fec947 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:34 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:34 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 1073741824 Aug 26 03:06:34 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:34 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b0ddd514-c466-4e12-accb-782fece0b107 tempest-CinderUnicodeTest-239262069 None] Create snapshot completed successfully Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Flow 'volume_create_manager' (84ea45f5-3573-4d79-965d-be7d0ed1167f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb800f8a-e7e7-4deb-b904-c2b797e71aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb800f8a-e7e7-4deb-b904-c2b797e71aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1793686260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94f0bfa1-fa36-49a4-8697-ea09069684f3,host='devstack@QuobyteHD#QuobyteHD',id=fedb67c7-17bb-4c82-b5dd-975258a06ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07fe5cfeab6488e9a9e4e2a7e3d463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:35Z,use_quota=True,user_id='a7cd03d9801447b98e19b9ac65221182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41734668-2e97-48cd-8791-3afff2017a8f),volume_type_id=41734668-2e97-48cd-8791-3afff2017a8f)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff4ba24-e8a0-480c-a38f-865c44ed3a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff4ba24-e8a0-480c-a38f-865c44ed3a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa378b49-9763-40ae-a274-bd6d952c3a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa378b49-9763-40ae-a274-bd6d952c3a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fedb67c7-17bb-4c82-b5dd-975258a06ad3', 'volume_name': 'volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a80b288-9aa7-45dc-bd19-9dbdb8dff0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a80b288-9aa7-45dc-bd19-9dbdb8dff0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046ee215-2093-40c3-902b-57397616b99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:35 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Volume fedb67c7-17bb-4c82-b5dd-975258a06ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3', 'volume_size': 1} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Acquiring lock "cinder-4d0fc511-a703-4bdd-8878-11b63ba7939c-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Lock "cinder-4d0fc511-a703-4bdd-8878-11b63ba7939c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Acquiring lock "cinder-quobyte-b08da84b-a39a-4101-b8b2-9fbf8e11029b" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Lock "cinder-quobyte-b08da84b-a39a-4101-b8b2-9fbf8e11029b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Acquiring lock "cinder-quobyte-4d0fc511-a703-4bdd-8878-11b63ba7939c" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Lock "cinder-quobyte-4d0fc511-a703-4bdd-8878-11b63ba7939c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Deleting offline snapshot 4d0fc511-a703-4bdd-8878-11b63ba7939c of volume b08da84b-a39a-4101-b8b2-9fbf8e11029b {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] snapshot_file for this snap is: volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b615af05-cf81-428c-8be7-0d59bd60fdc1]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:35 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c Aug 26 03:06:35 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:35 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 1073741824" returned: 0 in 0.659s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:35 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 Aug 26 03:06:35 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:35 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c" returned: 0 in 0.485s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca543f-d197-4f7a-8eb8-ff0b0392cc0b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:35 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94f0bfa1-fa36-49a4-8697-ea09069684f3,created_at=2026-08-26T01:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1793686260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94f0bfa1-fa36-49a4-8697-ea09069684f3,host='devstack@QuobyteHD#QuobyteHD',id=fedb67c7-17bb-4c82-b5dd-975258a06ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07fe5cfeab6488e9a9e4e2a7e3d463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:35Z,use_quota=True,user_id='a7cd03d9801447b98e19b9ac65221182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41734668-2e97-48cd-8791-3afff2017a8f),volume_type_id=41734668-2e97-48cd-8791-3afff2017a8f)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Creating volume fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:35 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:35 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 1073741824 Aug 26 03:06:35 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761d5091-e50d-487f-8ecb-05093c4fc738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8939409f-6f9b-4341-a389-cb3d10fec947', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9092ac6b-1864-46df-951f-be718b7ddba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:35 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b Aug 26 03:06:35 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:35 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Volume volume-8939409f-6f9b-4341-a389-cb3d10fec947 (8939409f-6f9b-4341-a389-cb3d10fec947): created successfully Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9092ac6b-1864-46df-951f-be718b7ddba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (509a3670-b79a-4098-b408-958694e909d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-fca241ee-079f-4655-be8e-3fef17d93ea1 tempest-VolumesGetTest-1050414135 None] Created volume successfully. Aug 26 03:06:36 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b" returned: 0 in 0.501s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:36 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c Aug 26 03:06:36 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:36 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 1073741824" returned: 0 in 0.633s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:36 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 Aug 26 03:06:36 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:36 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c" returned: 0 in 0.388s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:36 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c Aug 26 03:06:36 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:36 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3" returned: 0 in 0.283s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046ee215-2093-40c3-902b-57397616b99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd993d3-d9b4-413f-9697-cb2b1be2b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:36 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Volume volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 (fedb67c7-17bb-4c82-b5dd-975258a06ad3): created successfully Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd993d3-d9b4-413f-9697-cb2b1be2b64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Flow 'volume_create_manager' (84ea45f5-3573-4d79-965d-be7d0ed1167f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-613f0ef8-6607-46ce-936c-a1453695ba8c tempest-GroupsV314Test-769418447 None] Created volume successfully. Aug 26 03:06:37 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b.4d0fc511-a703-4bdd-8878-11b63ba7939c" returned: 0 in 0.270s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Lock "cinder-quobyte-4d0fc511-a703-4bdd-8878-11b63ba7939c" released by "_delete_snapshot" :: held 1.763s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Lock "cinder-quobyte-b08da84b-a39a-4101-b8b2-9fbf8e11029b" released by "delete_snapshot" :: held 1.788s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Created reservations ['a76e9775-2496-4337-ba0d-65d0dc505f0f', '59f8f027-c335-4f10-8cc1-ae193c506883', '19fe06c1-490e-4f13-a921-101936508519', 'df925059-b597-438a-9b69-aa83c1f0509f'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:37 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Delete snapshot completed successfully. Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2bcd33cc-d107-459f-8b9f-dc57cfcd6d1a tempest-CinderUnicodeTest-239262069 None] Lock "cinder-4d0fc511-a703-4bdd-8878-11b63ba7939c-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-8939409f-6f9b-4341-a389-cb3d10fec947-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Lock "cinder-8939409f-6f9b-4341-a389-cb3d10fec947-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "cinder-b08da84b-a39a-4101-b8b2-9fbf8e11029b-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-8939409f-6f9b-4341-a389-cb3d10fec947" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Lock "cinder-b08da84b-a39a-4101-b8b2-9fbf8e11029b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-8939409f-6f9b-4341-a389-cb3d10fec947" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a091176-f2fb-4bb1-89f5-c3613f6c7633]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "cinder-quobyte-b08da84b-a39a-4101-b8b2-9fbf8e11029b" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Lock "cinder-quobyte-b08da84b-a39a-4101-b8b2-9fbf8e11029b" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8155845b-1155-4e4e-a214-8c43d3e8284d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:37 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 Aug 26 03:06:37 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:37 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b Aug 26 03:06:37 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:38 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947" returned: 0 in 0.513s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:38 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947 Aug 26 03:06:38 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:38 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b" returned: 0 in 0.562s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:38 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b Aug 26 03:06:38 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:38 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Cloning volume fedb67c7-17bb-4c82-b5dd-975258a06ad3 to volume 9628b1e4-6ae5-4ff8-b696-c51753081cf6 Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Creating offline snapshot 40189599-e7cc-472c-bcb0-4b96309b83f8 of volume fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f67b2f-e6a1-48cc-a267-918c085f8277]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:38 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8939409f-6f9b-4341-a389-cb3d10fec947" returned: 0 in 0.414s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-8939409f-6f9b-4341-a389-cb3d10fec947" released by "delete_volume" :: held 1.012s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Created reservations ['82293a1f-2cb4-4dc8-bf1a-97dbc8b7040a', 'c5f8264f-abe4-4230-9c2d-84b00806b41b', 'a6e4a196-4b6c-4f52-8509-170c19d1bd40', '44496e3f-9c87-4b55-a290-899affecbd0e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:38 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b08da84b-a39a-4101-b8b2-9fbf8e11029b" returned: 0 in 0.496s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:38 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 Aug 26 03:06:38 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Lock "cinder-quobyte-b08da84b-a39a-4101-b8b2-9fbf8e11029b" released by "delete_volume" :: held 1.178s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:39 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:39 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Created reservations ['98e4ef72-dd79-465f-aa8b-0d18f06bf1c0', '8d76527b-6ff3-46cd-96bb-9a49ae808346', '5f81a7e6-2a11-405a-9381-ab0dabc01275', 'd96e54fe-d905-4680-85dc-7c0e4b7f1f88'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:39 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3" returned: 0 in 0.813s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:39 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:39 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:39 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 1G Aug 26 03:06:39 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:39 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.555s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:39 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Deleted volume successfully. Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-98162d5d-1ce9-4e6e-8519-37b03afa6613 tempest-VolumesGetTest-1050414135 None] Lock "cinder-8939409f-6f9b-4341-a389-cb3d10fec947-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:39 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.357s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:39 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Deleted volume successfully. Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6999aeb8-53c4-4ac2-8945-65c3f65d00c7 tempest-CinderUnicodeTest-239262069 None] Lock "cinder-b08da84b-a39a-4101-b8b2-9fbf8e11029b-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-83acc02d-bfeb-4f32-88e8-01a541e674eb-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "cinder-850aabb3-243f-4dad-96e9-557d13ef3d67-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Lock "cinder-83acc02d-bfeb-4f32-88e8-01a541e674eb-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Lock "cinder-850aabb3-243f-4dad-96e9-557d13ef3d67-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:40 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 1G" returned: 0 in 0.722s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:40 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 Aug 26 03:06:40 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-83acc02d-bfeb-4f32-88e8-01a541e674eb" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "cinder-quobyte-850aabb3-243f-4dad-96e9-557d13ef3d67" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-83acc02d-bfeb-4f32-88e8-01a541e674eb" acquired by "delete_volume" :: waited 0.061s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Lock "cinder-quobyte-850aabb3-243f-4dad-96e9-557d13ef3d67" acquired by "delete_volume" :: waited 0.056s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[815f9e46-b894-4f9a-9b12-007ded49bb5c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[127657ff-80eb-4f11-8f5a-61b60396d634]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:40 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb Aug 26 03:06:40 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:40 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 Aug 26 03:06:40 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:40 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8" returned: 0 in 0.554s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:40 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:40 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 Aug 26 03:06:40 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:40 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb" returned: 0 in 0.484s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:40 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb Aug 26 03:06:40 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:40 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67" returned: 0 in 0.553s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:40 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67 Aug 26 03:06:40 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:41 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8" returned: 0 in 0.362s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:41 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:41 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.info Aug 26 03:06:41 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-83acc02d-bfeb-4f32-88e8-01a541e674eb" returned: 0 in 0.320s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-83acc02d-bfeb-4f32-88e8-01a541e674eb" released by "delete_volume" :: held 0.924s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Created reservations ['bd4799e2-187f-4c09-ab8a-61b51310bc0f', 'd6005c2b-2d48-41af-985a-dfda80af9390', '0acc6699-2d4a-490f-9284-fd376d93e58a', 'f06a6027-27ae-43f6-81a6-403595133671'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:41 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-850aabb3-243f-4dad-96e9-557d13ef3d67" returned: 0 in 0.461s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Lock "cinder-quobyte-850aabb3-243f-4dad-96e9-557d13ef3d67" released by "delete_volume" :: held 1.091s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:41 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:41 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Created reservations ['408866cb-87b4-4fce-abaa-25335976907d', '9c209c3c-30ad-4030-b5ff-9286fa3fd2d3', '1ba6ef66-c99c-4879-8f92-aefd9bf4d1b2', '2854e6e6-1dc7-4b9a-ae80-d45075866be7'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:41 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.info" returned: 0 in 0.524s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:41 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:41 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.info Aug 26 03:06:41 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:41 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:41 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:41 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.406s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Deleted volume successfully. Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-18049c02-3cf6-4b9d-bee8-333c10641990 tempest-VolumesGetTest-1050414135 None] Lock "cinder-83acc02d-bfeb-4f32-88e8-01a541e674eb-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:41 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.info" returned: 0 in 0.338s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Acquiring lock "cinder-quobyte-9628b1e4-6ae5-4ff8-b696-c51753081cf6" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:41 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Lock "cinder-quobyte-9628b1e4-6ae5-4ff8-b696-c51753081cf6" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] snapshot: 40189599-e7cc-472c-bcb0-4b96309b83f8, volume: 9628b1e4-6ae5-4ff8-b696-c51753081cf6, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.357s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Deleted volume successfully. Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b54778-2dac-4a48-b3ab-65940fe08bb2]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-fc9ee64a-02b5-410c-9c47-d67be2d98673 tempest-CinderUnicodeTest-239262069 None] Lock "cinder-850aabb3-243f-4dad-96e9-557d13ef3d67-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:42 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 Aug 26 03:06:42 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:42 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8" returned: 0 in 0.481s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd41991-bf75-4edb-a7c5-a414f47ca81b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:42 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 Aug 26 03:06:42 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:43 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3" returned: 0 in 0.494s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:43 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 Aug 26 03:06:43 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Flow 'volume_create_manager' (17848ea2-162b-4af3-9443-4340a82e123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3531a0-148f-4cf2-81c6-265ffe6ba2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3531a0-148f-4cf2-81c6-265ffe6ba2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1774867065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005f99d1-ab75-461b-9ff0-adc410263b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb5d1fbe8044625b61df8bfcc4f9ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:43Z,use_quota=True,user_id='64532ea949654034b391273289cd4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620eb7c4-be45-4526-bf16-6427f47e5fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620eb7c4-be45-4526-bf16-6427f47e5fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a51a729-015c-4519-b1e7-87f4e52a9320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (e2f5d7f8-1071-4475-b1a8-1563dc89511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab95e533-a70b-479d-9885-4b770972da79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab95e533-a70b-479d-9885-4b770972da79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1058108870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40207aaa-2220-4944-a321-11239d507063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:43Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa28b285-db58-4f81-8321-98f83535e90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa28b285-db58-4f81-8321-98f83535e90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d3e040-47f5-4755-815c-c16eb296e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d3e040-47f5-4755-815c-c16eb296e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40207aaa-2220-4944-a321-11239d507063', 'volume_name': 'volume-40207aaa-2220-4944-a321-11239d507063', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db3d185-0242-4fab-9865-6d516b44044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db3d185-0242-4fab-9865-6d516b44044e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a312f813-d6d6-4709-be4d-fc94cdd199bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:43 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Volume 40207aaa-2220-4944-a321-11239d507063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40207aaa-2220-4944-a321-11239d507063', 'volume_size': 1} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a51a729-015c-4519-b1e7-87f4e52a9320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '005f99d1-ab75-461b-9ff0-adc410263b70', 'volume_name': 'volume-005f99d1-ab75-461b-9ff0-adc410263b70', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2a5c30-ca92-4087-b84b-4de6cc70f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2a5c30-ca92-4087-b84b-4de6cc70f058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bbe467-e55f-42ac-bb42-ee5458b1918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:44 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Volume 005f99d1-ab75-461b-9ff0-adc410263b70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-005f99d1-ab75-461b-9ff0-adc410263b70', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:06:44 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Trying to clone 005f99d1-ab75-461b-9ff0-adc410263b70 from image 9b965289-a39a-4dbd-8350-71f9403900aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:06:44 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:06:44 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:06:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f6778-04b6-4c7f-9468-302b851bc5ac]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:45 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD Aug 26 03:06:45 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:45 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD" returned: 0 in 0.952s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:45 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa is fetched for user 64532ea949654034b391273289cd4c5f. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:06:46 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd4604-69a4-4f46-bb45-44d3ba7629b3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:46 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD Aug 26 03:06:46 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:46 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:49 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6" returned: 0 in 6.123s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:06:49 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Converted 1024.00 MB image at 167.20 MB/s Aug 26 03:06:49 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:49 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 Aug 26 03:06:49 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:49 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6" returned: 0 in 0.307s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Lock "cinder-quobyte-9628b1e4-6ae5-4ff8-b696-c51753081cf6" released by "_copy_volume_from_snapshot" :: held 7.503s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Acquiring lock "cinder-quobyte-40189599-e7cc-472c-bcb0-4b96309b83f8" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Lock "cinder-quobyte-40189599-e7cc-472c-bcb0-4b96309b83f8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Deleting offline snapshot 40189599-e7cc-472c-bcb0-4b96309b83f8 of volume fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] snapshot_file for this snap is: volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[88219ec2-68ff-4c6c-bb3c-0dd346585c3f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:49 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 Aug 26 03:06:49 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:49 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8" returned: 0 in 0.433s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:06:50 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbe4b8d-ab6f-462b-84cc-b044f0de57c0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:50 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 Aug 26 03:06:50 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:50 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3" returned: 0 in 0.643s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:50 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 Aug 26 03:06:50 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:51 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8" returned: 0 in 0.443s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:51 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8 Aug 26 03:06:51 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:51 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3.40189599-e7cc-472c-bcb0-4b96309b83f8" returned: 0 in 0.299s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Lock "cinder-quobyte-40189599-e7cc-472c-bcb0-4b96309b83f8" released by "_delete_snapshot" :: held 1.949s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.030s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.028s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1058108870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40207aaa-2220-4944-a321-11239d507063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:43Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Creating volume 40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:51 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:06:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:51 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 1073741824 Aug 26 03:06:51 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:51 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b8037271-10f2-45d4-81a0-c1b5044bda7e tempest-GroupsV314Test-769418447 None] Create group from source-group-94f0bfa1-fa36-49a4-8697-ea09069684f3 completed successfully. Aug 26 03:06:52 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 1073741824" returned: 0 in 0.557s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:52 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 Aug 26 03:06:52 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:52 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063" returned: 0 in 0.278s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.439s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1774867065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005f99d1-ab75-461b-9ff0-adc410263b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb5d1fbe8044625b61df8bfcc4f9ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:43Z,use_quota=True,user_id='64532ea949654034b391273289cd4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Creating volume 005f99d1-ab75-461b-9ff0-adc410263b70 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:52 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a312f813-d6d6-4709-be4d-fc94cdd199bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40207aaa-2220-4944-a321-11239d507063', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:52 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 1073741824 Aug 26 03:06:52 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4462f1-3de8-4f45-bd88-35a445e342a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:52 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Volume volume-40207aaa-2220-4944-a321-11239d507063 (40207aaa-2220-4944-a321-11239d507063): created successfully Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4462f1-3de8-4f45-bd88-35a445e342a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (e2f5d7f8-1071-4475-b1a8-1563dc89511b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-251357bb-70ff-4b77-8866-2a5e90b8bff7 tempest-VolumesGetTest-1050414135 None] Created volume successfully. Aug 26 03:06:52 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 1073741824" returned: 0 in 0.578s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:53 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 Aug 26 03:06:53 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Acquiring lock "cinder-quobyte-9628b1e4-6ae5-4ff8-b696-c51753081cf6" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Lock "cinder-quobyte-9628b1e4-6ae5-4ff8-b696-c51753081cf6" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15375b0-1abf-4416-a365-2da5b6791d31]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:53 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 Aug 26 03:06:53 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:53 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70" returned: 0 in 0.382s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Attempting download of 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume 005f99d1-ab75-461b-9ff0-adc410263b70. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[29342b83-ca59-4fc8-a1dd-4db7041585fe]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_j23hgncu {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:53 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_j23hgncu Aug 26 03:06:53 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:53 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6" returned: 0 in 0.552s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:53 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6 Aug 26 03:06:53 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:54 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:54 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9628b1e4-6ae5-4ff8-b696-c51753081cf6" returned: 0 in 0.323s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_j23hgncu" returned: 0 in 0.525s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_j23hgncu {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Lock "cinder-quobyte-9628b1e4-6ae5-4ff8-b696-c51753081cf6" released by "delete_volume" :: held 0.962s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (f14c1a39-49f0-4661-8d11-d46ce77bef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b184df40-0990-482f-9b5c-13c8e0c13731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:54 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_j23hgncu Aug 26 03:06:54 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Created reservations ['4cfed04f-2928-4429-a01e-ff2092b4b47c'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b184df40-0990-482f-9b5c-13c8e0c13731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-203050306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf41f74-06a2-4307-9aca-7eb6e25cb9d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=40207aaa-2220-4944-a321-11239d507063,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:54Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f756c9e-d2b2-4e25-a6af-995ce2f4ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f756c9e-d2b2-4e25-a6af-995ce2f4ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a829424-aae3-4fc6-acdc-9da8f40c2946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a829424-aae3-4fc6-acdc-9da8f40c2946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9cf41f74-06a2-4307-9aca-7eb6e25cb9d0', 'volume_name': 'volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0', 'volume_size': 1, 'source_volid': '40207aaa-2220-4944-a321-11239d507063', 'source_volstatus': 'available'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d391fde-6dfe-4a08-a469-9d9f6b6e6bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d391fde-6dfe-4a08-a469-9d9f6b6e6bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5aad52-9361-4efb-9768-dc7597612c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:54 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Volume 9cf41f74-06a2-4307-9aca-7eb6e25cb9d0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0', 'volume_size': 1, 'source_volid': '40207aaa-2220-4944-a321-11239d507063', 'source_volstatus': 'available'} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:54 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Cloning volume 40207aaa-2220-4944-a321-11239d507063 to volume 9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 Aug 26 03:06:54 devstack cinder-volume[93797]: WARNING cinder.quota [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1131390920 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1131390920, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:06:54 devstack cinder-volume[93797]: WARNING cinder.quota [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1131390920 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1131390920, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Creating offline snapshot 2d097515-b5f1-49c4-a4b3-685058502af1 of volume 40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[18027b8b-06cc-4af4-99c0-7d3a07f417ea]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Created reservations ['987703c0-5549-4173-811d-bea0c1962487', '5fe60496-1693-43c7-8272-7abab98e7f0f', '926cbff9-3546-43ec-840c-41ffe7cf5676', 'be919b0b-4516-48b4-b6e8-37304b9ed13c'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:54 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_j23hgncu" returned: 1 in 0.520s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_j23hgncu' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b719ed2-8892-4e0f-af68-34b86ad5d776]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:54 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:54 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:54 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:54 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:54 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD Aug 26 03:06:54 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:54 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063" returned: 0 in 0.491s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:54 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 1G Aug 26 03:06:54 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:54 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.310s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:54 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d4904f36-267d-4c52-ac46-bbcf53950529 tempest-GroupsV314Test-769418447 None] Delete group completed successfully. Aug 26 03:06:55 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] 9b965289-a39a-4dbd-8350-71f9403900aa was qcow2, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:55 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 Aug 26 03:06:55 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:55 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 1G" returned: 0 in 0.531s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40207aaa-2220-4944-a321-11239d507063 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:55 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40207aaa-2220-4944-a321-11239d507063 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 Aug 26 03:06:55 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:55 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40207aaa-2220-4944-a321-11239d507063 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1" returned: 0 in 0.386s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:55 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 is being set with open permissions: ugo+rw Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:55 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 Aug 26 03:06:55 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Acquiring lock "cinder-quobyte-fedb67c7-17bb-4c82-b5dd-975258a06ad3" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Lock "cinder-quobyte-fedb67c7-17bb-4c82-b5dd-975258a06ad3" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3528fb-2cb9-431d-8cc3-8540dc66017e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:56 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 Aug 26 03:06:56 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:56 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1" returned: 0 in 0.343s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:56 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.info Aug 26 03:06:56 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:56 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3" returned: 0 in 0.523s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:56 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3 Aug 26 03:06:56 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:56 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.info" returned: 0 in 0.377s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:56 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.info is being set with open permissions: ugo+rw Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:56 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.info Aug 26 03:06:56 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:56 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fedb67c7-17bb-4c82-b5dd-975258a06ad3" returned: 0 in 0.355s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Lock "cinder-quobyte-fedb67c7-17bb-4c82-b5dd-975258a06ad3" released by "delete_volume" :: held 0.970s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:56 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.info" returned: 0 in 0.318s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] snapshot: 2d097515-b5f1-49c4-a4b3-685058502af1, volume: 9cf41f74-06a2-4307-9aca-7eb6e25cb9d0, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[30367065-e01d-43ed-b91a-111a900d27f5]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Created reservations ['c06cd5ed-4c54-47c1-ba7d-dba28bc9b323'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:57 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 Aug 26 03:06:57 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Created reservations ['e08f92b4-7eb9-4c82-8969-339c46632643', '7e26ece4-a566-410c-9994-e41050c7b796', '7d5ad36e-3a5a-4d34-b78c-e7d6fc6aec7e', '9a979a50-53ca-42ed-9719-dee88f050295'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:57 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:57 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:06:57 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70" returned: 0 in 2.651s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_dsnef22idevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:06:57 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Converted 112.00 MB image at 42.22 MB/s Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:57 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1" returned: 0 in 0.636s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40207aaa-2220-4944-a321-11239d507063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:06:57 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 1G Aug 26 03:06:57 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ea59f-d844-4b58-b050-2f4817bca856]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:57 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 Aug 26 03:06:57 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:57 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.383s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:57 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-654fd96a-6ee3-4c27-a692-c81e405408ad tempest-GroupsV314Test-769418447 None] Delete group completed successfully. Aug 26 03:06:58 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 1G" returned: 0 in 0.377s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Downloaded image 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume 005f99d1-ab75-461b-9ff0-adc410263b70 successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa for user 64532ea949654034b391273289cd4c5f is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Marking volume 005f99d1-ab75-461b-9ff0-adc410263b70 as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Copying metadata from image 9b965289-a39a-4dbd-8350-71f9403900aa to 005f99d1-ab75-461b-9ff0-adc410263b70. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Creating volume glance metadata for volume 005f99d1-ab75-461b-9ff0-adc410263b70 backed by image 9b965289-a39a-4dbd-8350-71f9403900aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bbe467-e55f-42ac-bb42-ee5458b1918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005f99d1-ab75-461b-9ff0-adc410263b70', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ae3964-888a-4354-b132-3b8408ce2f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:58 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063" returned: 0 in 0.489s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Volume volume-005f99d1-ab75-461b-9ff0-adc410263b70 (005f99d1-ab75-461b-9ff0-adc410263b70): created successfully Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ae3964-888a-4354-b132-3b8408ce2f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Flow 'volume_create_manager' (17848ea2-162b-4af3-9443-4340a82e123d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:58 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 Aug 26 03:06:58 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1f08d351-b888-4aff-9c18-51c415a899b5 tempest-VolumesExtendTest-1518235111 None] Created volume successfully. Aug 26 03:06:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7388f00f-3081-4420-a910-ce4f665c1619 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:01 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:02 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:02 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:02 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.898s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:07:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:07:04 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" returned: 0 in 6.054s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:07:04 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Converted 1024.00 MB image at 169.10 MB/s Aug 26 03:07:04 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 is being set with open permissions: ugo+rw Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:04 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 Aug 26 03:07:04 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:04 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" returned: 0 in 0.293s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" released by "_copy_volume_from_snapshot" :: held 7.597s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-2d097515-b5f1-49c4-a4b3-685058502af1" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-2d097515-b5f1-49c4-a4b3-685058502af1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Deleting offline snapshot 2d097515-b5f1-49c4-a4b3-685058502af1 of volume 40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] snapshot_file for this snap is: volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c17707-b4bf-4ab4-8093-584ee6d782da]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:04 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 Aug 26 03:07:04 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:05 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1" returned: 0 in 0.413s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40207aaa-2220-4944-a321-11239d507063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:07:05 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[454ceace-e58d-40a9-a43e-7553dca6fba3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:05 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 Aug 26 03:07:05 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:05 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063" returned: 0 in 0.631s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:05 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 Aug 26 03:07:05 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:06 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1" returned: 0 in 0.370s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:06 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1 Aug 26 03:07:06 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:06 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063.2d097515-b5f1-49c4-a4b3-685058502af1" returned: 0 in 0.300s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-2d097515-b5f1-49c4-a4b3-685058502af1" released by "_delete_snapshot" :: held 1.819s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.143s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7388f00f-3081-4420-a910-ce4f665c1619 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.556s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5aad52-9361-4efb-9768-dc7597612c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0', 'volume_size': 1, 'source_volid': '40207aaa-2220-4944-a321-11239d507063', 'source_volstatus': 'available'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecbc851-4ffd-4a46-a4e8-5f3c98ebe948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbea76a4-4035-471a-8b10-b3b703648403]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7388f00f-3081-4420-a910-ce4f665c1619 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:06 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Volume volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 (9cf41f74-06a2-4307-9aca-7eb6e25cb9d0): created successfully Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecbc851-4ffd-4a46-a4e8-5f3c98ebe948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (f14c1a39-49f0-4661-8d11-d46ce77bef1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f0f63bd1-8cb4-433f-bc01-d16a3a48f96a tempest-VolumesGetTest-1050414135 None] Created volume successfully. Aug 26 03:07:06 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 Aug 26 03:07:06 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:06 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7388f00f-3081-4420-a910-ce4f665c1619 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70" returned: 0 in 0.423s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7388f00f-3081-4420-a910-ce4f665c1619 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 2G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7388f00f-3081-4420-a910-ce4f665c1619 tempest-VolumesExtendTest-1518235111 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 2G" returned: 0 in 0.140s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7388f00f-3081-4420-a910-ce4f665c1619 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.616s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:07 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7388f00f-3081-4420-a910-ce4f665c1619 tempest-VolumesExtendTest-1518235111 None] Extend volume completed successfully. Aug 26 03:07:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c216a83d-ec71-4fed-9ecb-d8130cd347f6 tempest-GroupsV320Test-1181517020 None] Group tempest-GroupsV320Test-Group-682108703: creating Aug 26 03:07:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c216a83d-ec71-4fed-9ecb-d8130cd347f6 tempest-GroupsV320Test-1181517020 None] Group tempest-GroupsV320Test-Group-682108703: created successfully Aug 26 03:07:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c216a83d-ec71-4fed-9ecb-d8130cd347f6 tempest-GroupsV320Test-1181517020 None] Create group completed successfully. Aug 26 03:07:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Acquiring lock "cinder-005f99d1-ab75-461b-9ff0-adc410263b70-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Lock "cinder-005f99d1-ab75-461b-9ff0-adc410263b70-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Acquiring lock "cinder-quobyte-005f99d1-ab75-461b-9ff0-adc410263b70" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Lock "cinder-quobyte-005f99d1-ab75-461b-9ff0-adc410263b70" acquired by "delete_volume" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:08 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ef838d-b4bc-41b2-bea6-e487cd3780cc]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:08 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 Aug 26 03:07:08 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:09 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70" returned: 0 in 0.422s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:09 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70 Aug 26 03:07:09 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:09 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-005f99d1-ab75-461b-9ff0-adc410263b70" returned: 0 in 0.335s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Lock "cinder-quobyte-005f99d1-ab75-461b-9ff0-adc410263b70" released by "delete_volume" :: held 0.810s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=111,cinder:UPDATE=137,cinder:DELETE=12,cinder:INSERT=38 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Created reservations ['4bada5c0-6b33-42a7-ad4c-b3cab8563c1f', 'bc52ac46-19f6-40dd-ac9f-c9d61a1f5ea3', '189e011e-2884-48ee-8d7d-118d6f67cf32', '1ab07e41-f303-4cc3-b8f9-efc707926f68'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (4ffd9933-951b-4b79-bd76-ed127ffd2e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fa7865-1a0d-4834-b6ae-c2e257600b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fa7865-1a0d-4834-b6ae-c2e257600b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1172856397',display_name='tempest-VolumesGetTest-Volume-757000187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39397a16-35f5-43e8-ab6e-7b213b9a0839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:10Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92f7ea3-58d7-4300-a208-b14a1226c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92f7ea3-58d7-4300-a208-b14a1226c557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa378bed-dd5d-414e-aa24-49ec318abb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa378bed-dd5d-414e-aa24-49ec318abb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39397a16-35f5-43e8-ab6e-7b213b9a0839', 'volume_name': 'volume-39397a16-35f5-43e8-ab6e-7b213b9a0839', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d303ac5a-feb6-49d3-bda8-5c046bae44af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d303ac5a-feb6-49d3-bda8-5c046bae44af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2741286a-60ef-472d-9824-c220f416f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Volume 39397a16-35f5-43e8-ab6e-7b213b9a0839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39397a16-35f5-43e8-ab6e-7b213b9a0839', 'volume_size': 1} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1172856397',display_name='tempest-VolumesGetTest-Volume-757000187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39397a16-35f5-43e8-ab6e-7b213b9a0839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:10Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Creating volume 39397a16-35f5-43e8-ab6e-7b213b9a0839 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:09 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:09 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 1073741824 Aug 26 03:07:09 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:09 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:09 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Created reservations ['db1e4f78-7021-426d-9169-0dc1178ad20f'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:10 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:10 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:10 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.475s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Deleted volume successfully. Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ce6ee764-1ea8-4220-bb16-5cf5eb01790e tempest-VolumesExtendTest-1518235111 None] Lock "cinder-005f99d1-ab75-461b-9ff0-adc410263b70-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Flow 'volume_create_manager' (5866eaf5-c923-4ae8-bbf0-84f15b28ccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a20b41-f35e-4f24-8d2b-113a592438ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:10 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a20b41-f35e-4f24-8d2b-113a592438ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1008140292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8f41d2-5df5-4e24-bec0-28c69a37240a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb5d1fbe8044625b61df8bfcc4f9ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:10Z,use_quota=True,user_id='64532ea949654034b391273289cd4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f89a13f-1158-4292-ba66-1b242af21544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f89a13f-1158-4292-ba66-1b242af21544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a7c3ca-1183-4075-8236-70a910e37200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a7c3ca-1183-4075-8236-70a910e37200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8f41d2-5df5-4e24-bec0-28c69a37240a', 'volume_name': 'volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faafb4d6-0e42-4d9c-81db-8b89ffa90736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faafb4d6-0e42-4d9c-81db-8b89ffa90736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5d1b42-0a71-41a2-adac-77f31d8fc07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:10 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Volume ae8f41d2-5df5-4e24-bec0-28c69a37240a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a', 'volume_size': 1} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 1073741824" returned: 0 in 0.726s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:10 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 Aug 26 03:07:10 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:10 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.336s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b430b836-3491-467e-bd93-2f50229ab127 tempest-GroupsV320Test-1181517020 None] Delete group completed successfully. Aug 26 03:07:10 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839" returned: 0 in 0.265s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1008140292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8f41d2-5df5-4e24-bec0-28c69a37240a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb5d1fbe8044625b61df8bfcc4f9ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:10Z,use_quota=True,user_id='64532ea949654034b391273289cd4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Creating volume ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:10 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2741286a-60ef-472d-9824-c220f416f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39397a16-35f5-43e8-ab6e-7b213b9a0839', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:10 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a 1073741824 Aug 26 03:07:10 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86324086-c862-4961-98fe-44c90be031be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:10 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Volume volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 (39397a16-35f5-43e8-ab6e-7b213b9a0839): created successfully Aug 26 03:07:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86324086-c862-4961-98fe-44c90be031be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (4ffd9933-951b-4b79-bd76-ed127ffd2e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-96cdd8a6-9567-4017-a9d8-1402dc99b2ec tempest-VolumesGetTest-1050414135 None] Created volume successfully. Aug 26 03:07:11 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a 1073741824" returned: 0 in 0.568s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:11 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a Aug 26 03:07:11 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:11 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a" returned: 0 in 0.323s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5d1b42-0a71-41a2-adac-77f31d8fc07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed03b359-6479-4a46-bb89-c5028bd3ac13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:11 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Volume volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a (ae8f41d2-5df5-4e24-bec0-28c69a37240a): created successfully Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed03b359-6479-4a46-bb89-c5028bd3ac13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Flow 'volume_create_manager' (5866eaf5-c923-4ae8-bbf0-84f15b28ccd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b30ccd3e-3ebb-4772-bb79-040c1627b5a3 tempest-VolumesExtendTest-1518235111 None] Created volume successfully. Aug 26 03:07:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-39397a16-35f5-43e8-ab6e-7b213b9a0839-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Lock "cinder-39397a16-35f5-43e8-ab6e-7b213b9a0839-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-39397a16-35f5-43e8-ab6e-7b213b9a0839" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-39397a16-35f5-43e8-ab6e-7b213b9a0839" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd745905-4dab-4d6d-81c3-9b3e13564239]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:12 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 Aug 26 03:07:12 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:12 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839" returned: 0 in 0.528s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:12 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839 Aug 26 03:07:12 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Creating offline snapshot 6619f6a2-1f7e-4762-90db-270e93aa8da0 of volume ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c37dc3-6aa7-439e-8cfb-e50859ce64e6]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:13 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-39397a16-35f5-43e8-ab6e-7b213b9a0839" returned: 0 in 0.376s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-39397a16-35f5-43e8-ab6e-7b213b9a0839" released by "delete_volume" :: held 0.964s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Created reservations ['f6c86c20-ced3-4cec-895f-0be27ce02744', '605812c3-78a5-4c8e-bc3f-5089b8690ace', '2fe4b7c8-a7d9-4556-8749-7ae825410b57', '80363257-8b6c-46ab-8dd6-7a6e551abb48'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:13 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a Aug 26 03:07:13 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:13 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:13 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:13 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a" returned: 0 in 0.510s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:13 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 1G Aug 26 03:07:13 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:13 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.341s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Deleted volume successfully. Aug 26 03:07:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-82daa531-d2c4-4c0f-b21a-152439d6da9f tempest-VolumesGetTest-1050414135 None] Lock "cinder-39397a16-35f5-43e8-ab6e-7b213b9a0839-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:14 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 1G" returned: 0 in 0.541s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:14 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 Aug 26 03:07:14 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Lock "cinder-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" acquired by "delete_volume" :: waited 0.015s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:14 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0" returned: 0 in 0.413s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:14 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 is being set with open permissions: ugo+rw Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f1be1-46b5-43ff-b4bb-8f58dd981185]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:14 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 Aug 26 03:07:14 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:14 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 Aug 26 03:07:14 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:14 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0" returned: 0 in 0.301s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:14 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.info Aug 26 03:07:14 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:14 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" returned: 0 in 0.485s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:15 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0 Aug 26 03:07:15 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:15 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.info" returned: 0 in 0.308s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:15 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.info is being set with open permissions: ugo+rw Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:15 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.info Aug 26 03:07:15 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:15 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" returned: 0 in 0.314s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0" released by "delete_volume" :: held 0.874s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Created reservations ['cc363532-757f-4ced-bd5c-c1552ea8e33a', '78ef79b8-7808-4942-81ef-a3031cf889aa', '6857eec2-c513-418d-a7ad-29692d8ffcfe', '1f42fd54-ce8d-4abd-a089-721d16a01d24'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:15 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.info" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:15 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:15 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-252c666d-3438-41d0-afbf-a5c58f78a786 tempest-VolumesExtendTest-1518235111 None] Create snapshot completed successfully Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-40207aaa-2220-4944-a321-11239d507063-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Lock "cinder-40207aaa-2220-4944-a321-11239d507063-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-40207aaa-2220-4944-a321-11239d507063" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-40207aaa-2220-4944-a321-11239d507063" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[89776ef8-96fd-49bb-bbad-7f54b152393f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:15 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.383s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Deleted volume successfully. Aug 26 03:07:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c274d10-1946-4c77-bd23-d97cb2f5a18f tempest-VolumesGetTest-1050414135 None] Lock "cinder-9cf41f74-06a2-4307-9aca-7eb6e25cb9d0-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:15 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 Aug 26 03:07:15 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b998815c-2790-427d-acfe-e62769764d0b tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b998815c-2790-427d-acfe-e62769764d0b tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae01f3-6fb2-45d8-87c9-3d7771ca1086]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b998815c-2790-427d-acfe-e62769764d0b tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:16 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063" returned: 0 in 0.552s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:16 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063 Aug 26 03:07:16 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:16 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a Aug 26 03:07:16 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:16 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-40207aaa-2220-4944-a321-11239d507063" returned: 0 in 0.315s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-40207aaa-2220-4944-a321-11239d507063" released by "delete_volume" :: held 0.965s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Created reservations ['cf6561d2-0547-4bc7-a67d-8e0d20a35776', 'a2af8b5b-d970-45c3-b233-e904a46d9754', '3b3f3bc8-7453-459c-80c7-f818be4064c9', 'e79ff0e6-7b54-4cb9-a6f9-7ae6c20046bb'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:16 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b998815c-2790-427d-acfe-e62769764d0b tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a" returned: 0 in 0.536s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b998815c-2790-427d-acfe-e62769764d0b tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 2G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:16 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:16 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b998815c-2790-427d-acfe-e62769764d0b tempest-VolumesExtendTest-1518235111 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 2G" returned: 0 in 0.190s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b998815c-2790-427d-acfe-e62769764d0b tempest-VolumesExtendTest-1518235111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.779s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b998815c-2790-427d-acfe-e62769764d0b tempest-VolumesExtendTest-1518235111 None] Extend volume completed successfully. Aug 26 03:07:17 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.319s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Deleted volume successfully. Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9172db3b-22fe-44e7-9a20-f522337bbc6b tempest-VolumesGetTest-1050414135 None] Lock "cinder-40207aaa-2220-4944-a321-11239d507063-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "cinder-6619f6a2-1f7e-4762-90db-270e93aa8da0-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-6619f6a2-1f7e-4762-90db-270e93aa8da0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "cinder-quobyte-ae8f41d2-5df5-4e24-bec0-28c69a37240a" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-quobyte-ae8f41d2-5df5-4e24-bec0-28c69a37240a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "cinder-quobyte-6619f6a2-1f7e-4762-90db-270e93aa8da0" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-quobyte-6619f6a2-1f7e-4762-90db-270e93aa8da0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Deleting offline snapshot 6619f6a2-1f7e-4762-90db-270e93aa8da0 of volume ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] snapshot_file for this snap is: volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6748cb38-0c01-4ddf-b3f2-f88fd66a9c29]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:17 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 Aug 26 03:07:17 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:18 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0" returned: 0 in 0.488s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[03550542-3906-41ce-b237-7ce11b1cce47]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:18 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a Aug 26 03:07:18 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:18 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a" returned: 0 in 0.455s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:18 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 Aug 26 03:07:18 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (20ce209f-bb64-4d36-b919-5a21af4afedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc030007-c6c7-4f14-b935-a06232a038b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc030007-c6c7-4f14-b935-a06232a038b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1428083903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f645c92-ff18-44d4-908c-642dbd9584af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:19Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320ffacd-19a1-4ba9-8969-2e153f0a83ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320ffacd-19a1-4ba9-8969-2e153f0a83ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ffa9e4-1bf0-41ba-b87a-be494d7109bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:18 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:07:19 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0" returned: 0 in 0.509s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:19 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0 Aug 26 03:07:19 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ffa9e4-1bf0-41ba-b87a-be494d7109bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f645c92-ff18-44d4-908c-642dbd9584af', 'volume_name': 'volume-8f645c92-ff18-44d4-908c-642dbd9584af', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1bb181-615c-48c6-9053-6b8ab2251a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1bb181-615c-48c6-9053-6b8ab2251a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100de869-8ef8-4374-b038-425d1d638df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:19 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Volume 8f645c92-ff18-44d4-908c-642dbd9584af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f645c92-ff18-44d4-908c-642dbd9584af', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Trying to clone 8f645c92-ff18-44d4-908c-642dbd9584af from image 9b965289-a39a-4dbd-8350-71f9403900aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:07:19 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a.6619f6a2-1f7e-4762-90db-270e93aa8da0" returned: 0 in 0.327s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-quobyte-6619f6a2-1f7e-4762-90db-270e93aa8da0" released by "_delete_snapshot" :: held 2.033s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-quobyte-ae8f41d2-5df5-4e24-bec0-28c69a37240a" released by "delete_snapshot" :: held 2.084s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:07:19 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Created reservations ['1e9a8514-132d-4530-a776-b8fa0622f853', 'fa837529-eee0-447d-8343-35b0b07ac968', '5c3b78da-a5fd-498f-b740-6dabbb9b906a', '67b618b5-913d-4f0f-a035-541b73268224'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f493a4-4b0d-4e70-8d50-49670654e404]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Delete snapshot completed successfully. Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-943c3627-f063-407f-a7ac-609fab5f95c1 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-6619f6a2-1f7e-4762-90db-270e93aa8da0-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:20 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD Aug 26 03:07:20 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:20 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa is fetched for user 9a2eaadab9d94880bf604e9168120b01. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e61152-015e-479a-a851-f3e8e490cca1]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:20 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD Aug 26 03:07:20 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:20 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1428083903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f645c92-ff18-44d4-908c-642dbd9584af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:19Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Creating volume 8f645c92-ff18-44d4-908c-642dbd9584af {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:20 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:20 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af 1073741824 Aug 26 03:07:20 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "cinder-ae8f41d2-5df5-4e24-bec0-28c69a37240a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-ae8f41d2-5df5-4e24-bec0-28c69a37240a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "cinder-quobyte-ae8f41d2-5df5-4e24-bec0-28c69a37240a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-quobyte-ae8f41d2-5df5-4e24-bec0-28c69a37240a" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e384f7e-c91b-4ca4-8dc2-fa802963c67b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:21 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a Aug 26 03:07:21 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:21 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af 1073741824" returned: 0 in 0.607s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:21 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af Aug 26 03:07:21 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:21 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a" returned: 0 in 0.465s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:21 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a Aug 26 03:07:21 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:21 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af" returned: 0 in 0.293s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Attempting download of 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume 8f645c92-ff18-44d4-908c-642dbd9584af. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ee2c93-651b-4212-ba3f-bf4f6fb0c6e6]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_00gzscbw {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:21 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ae8f41d2-5df5-4e24-bec0-28c69a37240a" returned: 0 in 0.367s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-quobyte-ae8f41d2-5df5-4e24-bec0-28c69a37240a" released by "delete_volume" :: held 0.944s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Created reservations ['60c6f906-4ac6-4993-ac6a-141f7b45be06', 'f06ea238-d20c-49c6-9ce0-d283e2bdf316', '7bc605bf-b6f5-4100-b577-fe47c62c6496', 'a2b8d4bd-8fd0-4e13-9f98-841d194e8834'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:22 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_00gzscbw Aug 26 03:07:22 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:22 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:22 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:22 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_00gzscbw" returned: 0 in 0.494s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_00gzscbw {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:22 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.421s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:22 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_00gzscbw Aug 26 03:07:22 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:22 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Deleted volume successfully. Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cff3fea1-b0df-4e68-bb1e-b10c9099d083 tempest-VolumesExtendTest-1518235111 None] Lock "cinder-ae8f41d2-5df5-4e24-bec0-28c69a37240a-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:22 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_00gzscbw" returned: 1 in 0.431s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_00gzscbw' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a06d180-5cf8-449b-a68d-5940b1dbc4fe]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:23 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD Aug 26 03:07:23 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:23 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:23 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] 9b965289-a39a-4dbd-8350-71f9403900aa was qcow2, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:07:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:23 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af Aug 26 03:07:23 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:25 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af" returned: 0 in 2.563s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:25 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_ou59_kmwdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:07:25 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Converted 112.00 MB image at 43.66 MB/s Aug 26 03:07:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:25 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af 1G Aug 26 03:07:25 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:26 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af 1G" returned: 0 in 0.517s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Downloaded image 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume 8f645c92-ff18-44d4-908c-642dbd9584af successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa for user 9a2eaadab9d94880bf604e9168120b01 is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Marking volume 8f645c92-ff18-44d4-908c-642dbd9584af as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Copying metadata from image 9b965289-a39a-4dbd-8350-71f9403900aa to 8f645c92-ff18-44d4-908c-642dbd9584af. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Creating volume glance metadata for volume 8f645c92-ff18-44d4-908c-642dbd9584af backed by image 9b965289-a39a-4dbd-8350-71f9403900aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100de869-8ef8-4374-b038-425d1d638df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f645c92-ff18-44d4-908c-642dbd9584af', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b259db4b-854e-47d3-8197-6e23221c3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:26 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Volume volume-8f645c92-ff18-44d4-908c-642dbd9584af (8f645c92-ff18-44d4-908c-642dbd9584af): created successfully Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b259db4b-854e-47d3-8197-6e23221c3788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (20ce209f-bb64-4d36-b919-5a21af4afedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9eec991a-83bd-4674-8909-cc44dc307f53 tempest-VolumesGetTest-1050414135 None] Created volume successfully. Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=145,cinder:INSERT=48,cinder:UPDATE=152,cinder:DELETE=9 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (44e90137-8c38-41a9-94db-321388fde365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a3a3a7-a3e4-4260-aa86-30590aebecc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a3a3a7-a3e4-4260-aa86-30590aebecc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1291641520',display_name='tempest-VolumesGetTest-Volume-964915954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d339c815-cbe4-49ba-b222-8210222928f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:29Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c318862-f20d-4b43-bfc1-2ce08baf986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c318862-f20d-4b43-bfc1-2ce08baf986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2bff84-1927-4bcd-bb34-2a70429bf367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2bff84-1927-4bcd-bb34-2a70429bf367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd339c815-cbe4-49ba-b222-8210222928f1', 'volume_name': 'volume-d339c815-cbe4-49ba-b222-8210222928f1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b04146-5212-4923-a88a-3671d69e98f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b04146-5212-4923-a88a-3671d69e98f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b899265e-4c08-405d-b742-6265e50f6b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Volume d339c815-cbe4-49ba-b222-8210222928f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d339c815-cbe4-49ba-b222-8210222928f1', 'volume_size': 1} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1291641520',display_name='tempest-VolumesGetTest-Volume-964915954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d339c815-cbe4-49ba-b222-8210222928f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf40100fa1704e2589d5ef7fbf22c88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:29Z,use_quota=True,user_id='9a2eaadab9d94880bf604e9168120b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Creating volume d339c815-cbe4-49ba-b222-8210222928f1 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:28 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:07:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:28 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 1073741824 Aug 26 03:07:28 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:29 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 1073741824" returned: 0 in 0.604s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:29 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 Aug 26 03:07:29 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:29 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1" returned: 0 in 0.350s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b899265e-4c08-405d-b742-6265e50f6b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d339c815-cbe4-49ba-b222-8210222928f1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7810ee-d03f-45f6-9c09-131088061713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:29 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Volume volume-d339c815-cbe4-49ba-b222-8210222928f1 (d339c815-cbe4-49ba-b222-8210222928f1): created successfully Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7810ee-d03f-45f6-9c09-131088061713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Flow 'volume_create_manager' (44e90137-8c38-41a9-94db-321388fde365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6d802556-282d-41b8-b1cc-76960590569b tempest-VolumesGetTest-1050414135 None] Created volume successfully. Aug 26 03:07:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-d339c815-cbe4-49ba-b222-8210222928f1-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Lock "cinder-d339c815-cbe4-49ba-b222-8210222928f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-d339c815-cbe4-49ba-b222-8210222928f1" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-d339c815-cbe4-49ba-b222-8210222928f1" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:31 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d352e767-4265-4105-ad0f-55b5a3b10211]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:31 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 Aug 26 03:07:31 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:31 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1" returned: 0 in 0.576s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:31 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1 Aug 26 03:07:31 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:32 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d339c815-cbe4-49ba-b222-8210222928f1" returned: 0 in 0.317s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-d339c815-cbe4-49ba-b222-8210222928f1" released by "delete_volume" :: held 0.957s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Created reservations ['0a253f0b-2c3e-48ad-bea5-9f9d7d8336d6', '25422f95-636a-48ca-8687-66765212ef9e', '11d9dade-c0bc-46cd-8b75-0df57ae60939', '0114fe73-32e2-42fd-a0cc-734b4f1201de'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:32 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:32 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:32 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.341s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Deleted volume successfully. Aug 26 03:07:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-af4821e3-af28-45e9-9f84-0579e1f020e4 tempest-VolumesGetTest-1050414135 None] Lock "cinder-d339c815-cbe4-49ba-b222-8210222928f1-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-8f645c92-ff18-44d4-908c-642dbd9584af-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Lock "cinder-8f645c92-ff18-44d4-908c-642dbd9584af-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Acquiring lock "cinder-quobyte-8f645c92-ff18-44d4-908c-642dbd9584af" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-8f645c92-ff18-44d4-908c-642dbd9584af" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:33 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ddc80-1a1b-406e-9dbf-3dac30586ecd]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:33 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af Aug 26 03:07:33 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:34 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af" returned: 0 in 0.482s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:34 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af Aug 26 03:07:34 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:34 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8f645c92-ff18-44d4-908c-642dbd9584af" returned: 0 in 0.286s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Lock "cinder-quobyte-8f645c92-ff18-44d4-908c-642dbd9584af" released by "delete_volume" :: held 0.829s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Created reservations ['c9e8cf5a-e000-483d-8a02-8c238990f01b', '62efcc6c-3318-4457-966a-59de851bdb05', 'a336d2c9-6f69-4398-8feb-8fc678728a76', 'ce7ccb25-cf8c-4f83-ad93-6ac99218317b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:34 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:34 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:34 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.423s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:34 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:34 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Deleted volume successfully. Aug 26 03:07:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-761b48d8-f0f5-4be3-8bfc-c7710947413c tempest-VolumesGetTest-1050414135 None] Lock "cinder-8f645c92-ff18-44d4-908c-642dbd9584af-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:38 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Flow 'volume_create_manager' (b41a3040-1e04-42e1-9ed0-b110d6ede0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560d7bb3-94a4-4a01-8dcd-e4b2f4a3b8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560d7bb3-94a4-4a01-8dcd-e4b2f4a3b8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-229398826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f6f001-8648-431b-a906-70db88bc37ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308e23eea4fd404f8af26f0a6d310167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:38Z,use_quota=True,user_id='8904327d99274d5292bdd482bc1085df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bece1b8e-f60c-458a-a3b2-402b4a3e6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bece1b8e-f60c-458a-a3b2-402b4a3e6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c85be17-00e7-40c8-b99f-4859b81c174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:38 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:07:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c85be17-00e7-40c8-b99f-4859b81c174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9f6f001-8648-431b-a906-70db88bc37ba', 'volume_name': 'volume-a9f6f001-8648-431b-a906-70db88bc37ba', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7acfab91-9450-4e42-857d-dc00e467b225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7acfab91-9450-4e42-857d-dc00e467b225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fbdad4-be48-4bc2-b69b-5d29933f19d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:39 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Volume a9f6f001-8648-431b-a906-70db88bc37ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9f6f001-8648-431b-a906-70db88bc37ba', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:07:39 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Trying to clone a9f6f001-8648-431b-a906-70db88bc37ba from image 9b965289-a39a-4dbd-8350-71f9403900aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:07:39 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:07:39 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:07:39 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c892964d-7ce9-4003-b415-3b12fd2e9d8a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:39 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD Aug 26 03:07:39 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:40 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa is fetched for user 8904327d99274d5292bdd482bc1085df. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e94d0cc-a09d-451b-bf9f-1af37665753b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:40 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD Aug 26 03:07:40 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:40 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-229398826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f6f001-8648-431b-a906-70db88bc37ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308e23eea4fd404f8af26f0a6d310167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:38Z,use_quota=True,user_id='8904327d99274d5292bdd482bc1085df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Creating volume a9f6f001-8648-431b-a906-70db88bc37ba {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:40 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:07:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:40 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba 1073741824 Aug 26 03:07:40 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:41 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba 1073741824" returned: 0 in 0.639s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:41 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba Aug 26 03:07:41 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:41 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba" returned: 0 in 0.428s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:42 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Attempting download of 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume a9f6f001-8648-431b-a906-70db88bc37ba. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:07:42 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[da639017-b4fd-42b9-9e16-bbcf7508ece3]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_ztn_fygz {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:42 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_ztn_fygz Aug 26 03:07:42 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:42 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_ztn_fygz" returned: 0 in 0.537s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_ztn_fygz {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:42 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_ztn_fygz Aug 26 03:07:42 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:43 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_ztn_fygz" returned: 1 in 0.488s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_ztn_fygz' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:07:43 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ceea7-bde3-41f1-b496-b03c5748c18c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:43 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD Aug 26 03:07:43 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:43 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:43 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] 9b965289-a39a-4dbd-8350-71f9403900aa was qcow2, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:07:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:43 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba Aug 26 03:07:43 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:46 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba" returned: 0 in 2.626s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_7gahk2e0devstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:07:46 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Converted 112.00 MB image at 42.63 MB/s Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:46 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba 1G Aug 26 03:07:46 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:46 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba 1G" returned: 0 in 0.551s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Downloaded image 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume a9f6f001-8648-431b-a906-70db88bc37ba successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa for user 8904327d99274d5292bdd482bc1085df is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Marking volume a9f6f001-8648-431b-a906-70db88bc37ba as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Copying metadata from image 9b965289-a39a-4dbd-8350-71f9403900aa to a9f6f001-8648-431b-a906-70db88bc37ba. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Creating volume glance metadata for volume a9f6f001-8648-431b-a906-70db88bc37ba backed by image 9b965289-a39a-4dbd-8350-71f9403900aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fbdad4-be48-4bc2-b69b-5d29933f19d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f6f001-8648-431b-a906-70db88bc37ba', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed01ec1-3d7a-48d1-8ff4-15c2fd511097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:46 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Volume volume-a9f6f001-8648-431b-a906-70db88bc37ba (a9f6f001-8648-431b-a906-70db88bc37ba): created successfully Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed01ec1-3d7a-48d1-8ff4-15c2fd511097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Flow 'volume_create_manager' (b41a3040-1e04-42e1-9ed0-b110d6ede0df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:47 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-46890527-142f-449c-8b0b-34f5808da568 tempest-VolumesImageMetadata-501593124 None] Created volume successfully. Aug 26 03:07:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Acquiring lock "cinder-a9f6f001-8648-431b-a906-70db88bc37ba-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Lock "cinder-a9f6f001-8648-431b-a906-70db88bc37ba-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Acquiring lock "cinder-quobyte-a9f6f001-8648-431b-a906-70db88bc37ba" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Lock "cinder-quobyte-a9f6f001-8648-431b-a906-70db88bc37ba" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:47 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00754ec-b2f0-4dc2-b9a9-16d4ba9982cd]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:47 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba Aug 26 03:07:47 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:48 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba" returned: 0 in 0.523s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:48 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba Aug 26 03:07:48 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:48 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a9f6f001-8648-431b-a906-70db88bc37ba" returned: 0 in 0.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Lock "cinder-quobyte-a9f6f001-8648-431b-a906-70db88bc37ba" released by "delete_volume" :: held 0.908s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Created reservations ['de0962d8-5957-4fd7-921f-1eabd32e7a1f', 'ba864a6a-a281-499f-ad7a-f800e112202c', '0a007d38-a54b-4705-9225-c5325421e698', '3d282e76-847e-4857-97a1-db6464605008'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:48 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:07:48 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:49 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.275s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:49 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Deleted volume successfully. Aug 26 03:07:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4b676320-9d91-4264-aea8-277fa9e2cf09 tempest-VolumesImageMetadata-501593124 None] Lock "cinder-a9f6f001-8648-431b-a906-70db88bc37ba-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (a79a0f73-3030-4828-856a-8c56ace3714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea842f5-9e25-492a-b136-983e7cfdba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea842f5-9e25-492a-b136-983e7cfdba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2136995557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd03787b-f6cb-4290-919e-04840d25e906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64aaa0bf9774d188a23bb21ef9874fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:58Z,use_quota=True,user_id='ba7330b2dc164005b1b58eb72f470916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d618c2-06ff-41bb-80af-a95d36ff33e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d618c2-06ff-41bb-80af-a95d36ff33e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f78412-3d01-4869-b730-a2b0f49b008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f78412-3d01-4869-b730-a2b0f49b008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd03787b-f6cb-4290-919e-04840d25e906', 'volume_name': 'volume-bd03787b-f6cb-4290-919e-04840d25e906', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8456c7-4e6d-454d-bd09-e3e525ee0116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8456c7-4e6d-454d-bd09-e3e525ee0116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2207eb69-bc4b-4217-ab63-700431e3dd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Volume bd03787b-f6cb-4290-919e-04840d25e906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd03787b-f6cb-4290-919e-04840d25e906', 'volume_size': 1} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2136995557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd03787b-f6cb-4290-919e-04840d25e906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64aaa0bf9774d188a23bb21ef9874fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:58Z,use_quota=True,user_id='ba7330b2dc164005b1b58eb72f470916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Creating volume bd03787b-f6cb-4290-919e-04840d25e906 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:58 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:07:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:58 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 1073741824 Aug 26 03:07:58 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:59 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 1073741824" returned: 0 in 0.643s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:59 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 Aug 26 03:07:59 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:59 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906" returned: 0 in 0.411s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2207eb69-bc4b-4217-ab63-700431e3dd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd03787b-f6cb-4290-919e-04840d25e906', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886bd4f3-82dc-4d2b-85d3-1652c542c409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:59 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Volume volume-bd03787b-f6cb-4290-919e-04840d25e906 (bd03787b-f6cb-4290-919e-04840d25e906): created successfully Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886bd4f3-82dc-4d2b-85d3-1652c542c409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (a79a0f73-3030-4828-856a-8c56ace3714b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7d8c4912-1f0f-490c-9eff-70a2a1d719f3 tempest-VolumesSnapshotTestJSON-319968539 None] Created volume successfully. Aug 26 03:08:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Creating offline snapshot 266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 of volume bd03787b-f6cb-4290-919e-04840d25e906 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[811e0ffa-3cdc-4676-9b19-928b6eeefe0e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:01 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 Aug 26 03:08:01 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Flow 'volume_create_manager' (233c6da2-4be7-4a17-ae9e-aba5074fcb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53a95b2-61bb-4acb-8ff9-dae8356bbe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53a95b2-61bb-4acb-8ff9-dae8356bbe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1740226024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2180c191-bc34-4c0b-8853-b3872476f565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e88589babc436abd5450c89de9fc62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:01Z,use_quota=True,user_id='12a11d886b2648abbbfe008f73165812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95454d2f-9153-4429-8f0b-3ade5a648cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95454d2f-9153-4429-8f0b-3ade5a648cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e271ac6d-0230-4162-8d25-84a415ed6f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e271ac6d-0230-4162-8d25-84a415ed6f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2180c191-bc34-4c0b-8853-b3872476f565', 'volume_name': 'volume-2180c191-bc34-4c0b-8853-b3872476f565', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf349481-af65-4fc1-a46c-0c835d0034a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf349481-af65-4fc1-a46c-0c835d0034a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24de53b2-afb0-43ee-8e31-d8d73bc2e43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:01 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Volume 2180c191-bc34-4c0b-8853-b3872476f565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2180c191-bc34-4c0b-8853-b3872476f565', 'volume_size': 1} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:01 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906" returned: 0 in 0.572s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:01 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 1G Aug 26 03:08:01 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Flow 'volume_create_manager' (4a5959bc-feac-4a8c-be38-d40834f307e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f5ae56-e112-4d14-b4d8-29f372913de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:02 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f5ae56-e112-4d14-b4d8-29f372913de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1265964688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a90022-8579-4201-a16b-f7e56d139033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e88589babc436abd5450c89de9fc62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:02Z,use_quota=True,user_id='12a11d886b2648abbbfe008f73165812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:02 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa834487-4a33-4189-bf52-515937ea7ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa834487-4a33-4189-bf52-515937ea7ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2067ff-6f9d-4f1e-a4a5-3460d7bf5769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2067ff-6f9d-4f1e-a4a5-3460d7bf5769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a90022-8579-4201-a16b-f7e56d139033', 'volume_name': 'volume-03a90022-8579-4201-a16b-f7e56d139033', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1b978b-4902-41b8-a83e-0b5977570579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1b978b-4902-41b8-a83e-0b5977570579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d231694-4dc8-4c1b-b22c-2a6512d6c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Volume 03a90022-8579-4201-a16b-f7e56d139033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a90022-8579-4201-a16b-f7e56d139033', 'volume_size': 1} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:02 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 1G" returned: 0 in 0.603s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd03787b-f6cb-4290-919e-04840d25e906 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:02 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd03787b-f6cb-4290-919e-04840d25e906 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 Aug 26 03:08:02 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:02 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.386s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Flow 'volume_create_manager' (c04c0479-e23d-4bdd-b40e-af966fa5979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15387d1-5828-4c1a-b4f2-ab5278fa960e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15387d1-5828-4c1a-b4f2-ab5278fa960e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1137076714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b82196e-ccb8-457e-b2ad-dc30b43121a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b9a30899204c1d86a7215137e6614d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:03Z,use_quota=True,user_id='c798310d7d5e485da74c983287c107f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39ea9e0-ad26-4fe3-96cc-a7552c5885cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39ea9e0-ad26-4fe3-96cc-a7552c5885cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11ff45f-2a7e-47bc-9b63-ddcc1da798c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11ff45f-2a7e-47bc-9b63-ddcc1da798c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b82196e-ccb8-457e-b2ad-dc30b43121a3', 'volume_name': 'volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c10597-a1a6-40a4-bfb8-fa59b5f6b5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c10597-a1a6-40a4-bfb8-fa59b5f6b5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419d745c-a3b0-4664-ac44-97384dc3a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:02 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Volume 9b82196e-ccb8-457e-b2ad-dc30b43121a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3', 'volume_size': 1} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd03787b-f6cb-4290-919e-04840d25e906 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4" returned: 0 in 0.503s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:02 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 is being set with open permissions: ugo+rw Aug 26 03:08:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:02 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 Aug 26 03:08:02 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:03 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4" returned: 0 in 0.288s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:03 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.info Aug 26 03:08:03 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:03 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.info" returned: 0 in 0.321s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:03 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.info is being set with open permissions: ugo+rw Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:03 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.info Aug 26 03:08:03 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:03 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.info" returned: 0 in 0.279s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1740226024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2180c191-bc34-4c0b-8853-b3872476f565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e88589babc436abd5450c89de9fc62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:01Z,use_quota=True,user_id='12a11d886b2648abbbfe008f73165812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Creating volume 2180c191-bc34-4c0b-8853-b3872476f565 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:03 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:08:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:03 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 1073741824 Aug 26 03:08:03 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0ae9ea4a-c791-4450-bb39-a9a418d52179 tempest-VolumesSnapshotTestJSON-319968539 None] Create snapshot completed successfully Aug 26 03:08:04 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-266c6013-ff82-47d7-83d1-4ed1c4bf0ed4-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 1073741824" returned: 0 in 0.702s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-266c6013-ff82-47d7-83d1-4ed1c4bf0ed4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:04 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-bd03787b-f6cb-4290-919e-04840d25e906" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:04 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-bd03787b-f6cb-4290-919e-04840d25e906" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-266c6013-ff82-47d7-83d1-4ed1c4bf0ed4" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-266c6013-ff82-47d7-83d1-4ed1c4bf0ed4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Deleting offline snapshot 266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 of volume bd03787b-f6cb-4290-919e-04840d25e906 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] snapshot_file for this snap is: volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f754ca43-dd9b-4f27-8000-3e9511a900cb]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:04 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 Aug 26 03:08:04 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:04 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565" returned: 0 in 0.343s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.690s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1265964688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a90022-8579-4201-a16b-f7e56d139033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e88589babc436abd5450c89de9fc62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:02Z,use_quota=True,user_id='12a11d886b2648abbbfe008f73165812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Creating volume 03a90022-8579-4201-a16b-f7e56d139033 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:04 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:04 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 1073741824 Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24de53b2-afb0-43ee-8e31-d8d73bc2e43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2180c191-bc34-4c0b-8853-b3872476f565', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:04 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00959d8-f6ff-4207-b9bf-6b9454267e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:04 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Volume volume-2180c191-bc34-4c0b-8853-b3872476f565 (2180c191-bc34-4c0b-8853-b3872476f565): created successfully Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00959d8-f6ff-4207-b9bf-6b9454267e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Flow 'volume_create_manager' (233c6da2-4be7-4a17-ae9e-aba5074fcb71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:04 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e1e3efcc-857f-4f23-ba39-916d8424d42d tempest-TestServerVolumeAttachmentScenario-1883150438 None] Created volume successfully. Aug 26 03:08:05 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4" returned: 0 in 0.509s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd03787b-f6cb-4290-919e-04840d25e906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d4dcb8-0906-4283-ade4-fd9a3bcf15a4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:05 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 Aug 26 03:08:05 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:05 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 1073741824" returned: 0 in 0.566s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:05 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 Aug 26 03:08:05 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:05 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906" returned: 0 in 0.487s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:05 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 Aug 26 03:08:05 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:05 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033" returned: 0 in 0.354s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.087s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1137076714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b82196e-ccb8-457e-b2ad-dc30b43121a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b9a30899204c1d86a7215137e6614d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:03Z,use_quota=True,user_id='c798310d7d5e485da74c983287c107f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Creating volume 9b82196e-ccb8-457e-b2ad-dc30b43121a3 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:05 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:05 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 1073741824 Aug 26 03:08:05 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d231694-4dc8-4c1b-b22c-2a6512d6c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a90022-8579-4201-a16b-f7e56d139033', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4372a5-bc64-4c5f-9b45-b2d2de51c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:05 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Volume volume-03a90022-8579-4201-a16b-f7e56d139033 (03a90022-8579-4201-a16b-f7e56d139033): created successfully Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4372a5-bc64-4c5f-9b45-b2d2de51c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Flow 'volume_create_manager' (4a5959bc-feac-4a8c-be38-d40834f307e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:05 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8497f4a4-664c-4387-9205-87d5a6e46568 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Created volume successfully. Aug 26 03:08:06 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4" returned: 0 in 0.489s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:06 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4 Aug 26 03:08:06 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:06 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906.266c6013-ff82-47d7-83d1-4ed1c4bf0ed4" returned: 0 in 0.329s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:06 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 1073741824" returned: 0 in 0.712s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-266c6013-ff82-47d7-83d1-4ed1c4bf0ed4" released by "_delete_snapshot" :: held 1.994s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-bd03787b-f6cb-4290-919e-04840d25e906" released by "delete_snapshot" :: held 2.036s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:06 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 Aug 26 03:08:06 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Created reservations ['33ad4aaa-9052-4a44-ba85-d0e8a91fc62f', 'a5af9ac0-09d1-4c43-9849-39e0313fa8e0', '4aeeea3c-d377-467d-82fe-61216a3b0689', '106789a3-3c2e-4593-a1df-a7fa87ea6477'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Delete snapshot completed successfully. Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d846a89e-b032-47bd-a9f9-0988997f1680 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-266c6013-ff82-47d7-83d1-4ed1c4bf0ed4-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:06 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3" returned: 0 in 0.336s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419d745c-a3b0-4664-ac44-97384dc3a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec24b3e-07d8-4dc4-b757-c0882863ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:06 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Volume volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 (9b82196e-ccb8-457e-b2ad-dc30b43121a3): created successfully Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec24b3e-07d8-4dc4-b757-c0882863ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Flow 'volume_create_manager' (c04c0479-e23d-4bdd-b40e-af966fa5979a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-730b869c-db0a-4c17-9973-06cbd72692cf tempest-VolumesTransfersV357Test-1315192668 None] Created volume successfully. Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (9b048a43-3978-4c99-8c99-e53a58d3941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e418b59-585e-40f9-9ecf-e558f8f5efd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e418b59-585e-40f9-9ecf-e558f8f5efd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-426488794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae43cf1-0794-4593-96f5-faf769ac31ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64aaa0bf9774d188a23bb21ef9874fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:08Z,use_quota=True,user_id='ba7330b2dc164005b1b58eb72f470916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e3cdcd-e490-4b96-9dd3-f4c275802f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e3cdcd-e490-4b96-9dd3-f4c275802f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd03a49a-1afb-4b53-9b99-7a0f3602cf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd03a49a-1afb-4b53-9b99-7a0f3602cf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae43cf1-0794-4593-96f5-faf769ac31ba', 'volume_name': 'volume-eae43cf1-0794-4593-96f5-faf769ac31ba', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da8acd5-fe18-4a86-a01a-48d0f629d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da8acd5-fe18-4a86-a01a-48d0f629d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aa13ad-3e47-4888-986b-6294e4534a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:08 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Volume eae43cf1-0794-4593-96f5-faf769ac31ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae43cf1-0794-4593-96f5-faf769ac31ba', 'volume_size': 1} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-426488794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae43cf1-0794-4593-96f5-faf769ac31ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64aaa0bf9774d188a23bb21ef9874fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:08Z,use_quota=True,user_id='ba7330b2dc164005b1b58eb72f470916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Creating volume eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:08 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:08:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:08 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba 1073741824 Aug 26 03:08:08 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2c2f0b61-6e0b-40da-9b8c-d9eb0a377c2e tempest-VolumesTransfersV357Test-12534326 None] Transfer volume completed successfully. Aug 26 03:08:09 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba 1073741824" returned: 0 in 0.596s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:09 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba Aug 26 03:08:09 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:09 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba" returned: 0 in 0.382s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Acquiring lock "cinder-9b82196e-ccb8-457e-b2ad-dc30b43121a3-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aa13ad-3e47-4888-986b-6294e4534a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae43cf1-0794-4593-96f5-faf769ac31ba', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab4e5f4-b442-428c-af2c-d299248414b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=99,cinder:INSERT=45,cinder:UPDATE=124,cinder:DELETE=9 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:08:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Volume volume-eae43cf1-0794-4593-96f5-faf769ac31ba (eae43cf1-0794-4593-96f5-faf769ac31ba): created successfully Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab4e5f4-b442-428c-af2c-d299248414b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (9b048a43-3978-4c99-8c99-e53a58d3941c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Lock "cinder-9b82196e-ccb8-457e-b2ad-dc30b43121a3-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-046c4e4f-73f6-4c2f-90ce-fca83a42ab94 tempest-VolumesSnapshotTestJSON-319968539 None] Created volume successfully. Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Acquiring lock "cinder-quobyte-9b82196e-ccb8-457e-b2ad-dc30b43121a3" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Lock "cinder-quobyte-9b82196e-ccb8-457e-b2ad-dc30b43121a3" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18be13e-d967-45ae-b6e4-1d60555b905a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:10 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 Aug 26 03:08:10 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:10 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3" returned: 0 in 0.439s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:10 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3 Aug 26 03:08:10 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Creating offline snapshot 85b8ef6d-38b9-4eda-b46c-5122d9970fdc of volume eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c3d95-a003-4d80-beb3-40e1401a09f3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:10 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9b82196e-ccb8-457e-b2ad-dc30b43121a3" returned: 0 in 0.360s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Lock "cinder-quobyte-9b82196e-ccb8-457e-b2ad-dc30b43121a3" released by "delete_volume" :: held 0.868s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:10 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Created reservations ['9026d0f6-aa48-4add-8a2e-1e11b918eded', 'f2a3e16f-4fe4-4266-8c1a-3bf8ad326cea', '2c599b60-f62c-4058-8566-c8e8df056673', '8e2917b6-8811-427d-b6ed-16a68530ff24'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:10 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba Aug 26 03:08:10 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:11 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:08:11 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:11 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba" returned: 0 in 0.985s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:11 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc 1G Aug 26 03:08:11 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:11 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.742s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Deleted volume successfully. Aug 26 03:08:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a6af1319-8f5f-40fe-bcc8-6d98603782e1 tempest-VolumesTransfersV357Test-1111615632 None] Lock "cinder-9b82196e-ccb8-457e-b2ad-dc30b43121a3-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Flow 'volume_create_manager' (541c53a2-f038-4822-b626-000487c9d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212332c7-e86b-4dba-be3c-1cce04edd4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212332c7-e86b-4dba-be3c-1cce04edd4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1366292312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b56f14-cdbe-4505-ae99-e07ead81a256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b9a30899204c1d86a7215137e6614d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:13Z,use_quota=True,user_id='c798310d7d5e485da74c983287c107f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54059089-bde9-4420-8c38-004d8a32b212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54059089-bde9-4420-8c38-004d8a32b212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe23f86-6c64-42a7-ac47-84aa4e3c7991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe23f86-6c64-42a7-ac47-84aa4e3c7991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b56f14-cdbe-4505-ae99-e07ead81a256', 'volume_name': 'volume-90b56f14-cdbe-4505-ae99-e07ead81a256', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445a3cec-7335-41de-b4ea-2914d10b902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445a3cec-7335-41de-b4ea-2914d10b902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec935603-6db7-46f4-bc88-fbd219b8669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:12 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Volume 90b56f14-cdbe-4505-ae99-e07ead81a256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b56f14-cdbe-4505-ae99-e07ead81a256', 'volume_size': 1} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:12 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc 1G" returned: 0 in 0.988s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae43cf1-0794-4593-96f5-faf769ac31ba -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:12 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae43cf1-0794-4593-96f5-faf769ac31ba -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc Aug 26 03:08:12 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:13 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae43cf1-0794-4593-96f5-faf769ac31ba -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc" returned: 0 in 0.364s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:13 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc is being set with open permissions: ugo+rw Aug 26 03:08:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:13 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc Aug 26 03:08:13 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:13 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc" returned: 0 in 0.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:13 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.info Aug 26 03:08:13 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:13 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.info" returned: 0 in 0.271s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:13 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.info is being set with open permissions: ugo+rw Aug 26 03:08:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:13 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.info Aug 26 03:08:13 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:14 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.info" returned: 0 in 0.316s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1366292312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b56f14-cdbe-4505-ae99-e07ead81a256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b9a30899204c1d86a7215137e6614d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:13Z,use_quota=True,user_id='c798310d7d5e485da74c983287c107f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Creating volume 90b56f14-cdbe-4505-ae99-e07ead81a256 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:14 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:14 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 1073741824 Aug 26 03:08:14 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:14 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a8238e0d-6fa4-4aaf-b874-c82e34b64c4c tempest-VolumesSnapshotTestJSON-319968539 None] Create snapshot completed successfully Aug 26 03:08:14 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 1073741824" returned: 0 in 0.631s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:14 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 Aug 26 03:08:14 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:15 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256" returned: 0 in 0.301s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec935603-6db7-46f4-bc88-fbd219b8669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b56f14-cdbe-4505-ae99-e07ead81a256', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3438d6-8431-425f-bceb-9f62860f02db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Volume volume-90b56f14-cdbe-4505-ae99-e07ead81a256 (90b56f14-cdbe-4505-ae99-e07ead81a256): created successfully Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3438d6-8431-425f-bceb-9f62860f02db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Flow 'volume_create_manager' (541c53a2-f038-4822-b626-000487c9d52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0003335d-e12a-4527-8890-415577c156f2 tempest-VolumesTransfersV357Test-1315192668 None] Created volume successfully. Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (95c70226-5cdc-4ff9-9bd3-4daedf85c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad32449-46b6-432b-a569-5d89087c2ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad32449-46b6-432b-a569-5d89087c2ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1756157466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28859e9f-817e-49ee-a235-71889c8b3576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64aaa0bf9774d188a23bb21ef9874fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=85b8ef6d-38b9-4eda-b46c-5122d9970fdc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:16Z,use_quota=True,user_id='ba7330b2dc164005b1b58eb72f470916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9521f53b-eca2-4d1b-be1d-91e1e50853e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9521f53b-eca2-4d1b-be1d-91e1e50853e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdb70d8-59d4-4fce-93d5-d7f4a5c70ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdb70d8-59d4-4fce-93d5-d7f4a5c70ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28859e9f-817e-49ee-a235-71889c8b3576', 'volume_name': 'volume-28859e9f-817e-49ee-a235-71889c8b3576', 'volume_size': 2, 'snapshot_id': '85b8ef6d-38b9-4eda-b46c-5122d9970fdc'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9e1de8-fcb8-4630-ae6d-f5ca3fec901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9e1de8-fcb8-4630-ae6d-f5ca3fec901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6503f2e2-bef5-451b-9f80-be6407028566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Volume 28859e9f-817e-49ee-a235-71889c8b3576: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28859e9f-817e-49ee-a235-71889c8b3576', 'volume_size': 2, 'snapshot_id': '85b8ef6d-38b9-4eda-b46c-5122d9970fdc'} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-85b8ef6d-38b9-4eda-b46c-5122d9970fdc-28859e9f-817e-49ee-a235-71889c8b3576" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-85b8ef6d-38b9-4eda-b46c-5122d9970fdc-28859e9f-817e-49ee-a235-71889c8b3576" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Creating volume 28859e9f-817e-49ee-a235-71889c8b3576 from snapshot 85b8ef6d-38b9-4eda-b46c-5122d9970fdc {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-28859e9f-817e-49ee-a235-71889c8b3576" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-28859e9f-817e-49ee-a235-71889c8b3576" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] snapshot: 85b8ef6d-38b9-4eda-b46c-5122d9970fdc, volume: 28859e9f-817e-49ee-a235-71889c8b3576, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc39cf2-ccdd-44b6-8c3a-0450cfb2a54e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:16 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc Aug 26 03:08:16 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Acquiring lock "cinder-90b56f14-cdbe-4505-ae99-e07ead81a256-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Lock "cinder-90b56f14-cdbe-4505-ae99-e07ead81a256-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Acquiring lock "cinder-quobyte-90b56f14-cdbe-4505-ae99-e07ead81a256" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Lock "cinder-quobyte-90b56f14-cdbe-4505-ae99-e07ead81a256" acquired by "delete_volume" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee6949e-8818-4649-aeed-e532e66f9c95]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:16 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc" returned: 0 in 0.562s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eae43cf1-0794-4593-96f5-faf769ac31ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e3eeb0-7e1e-4167-885b-16091b43de27]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:16 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 Aug 26 03:08:16 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:16 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba Aug 26 03:08:16 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:17 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256" returned: 0 in 0.556s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:17 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256 Aug 26 03:08:17 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:17 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba" returned: 0 in 0.616s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:17 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 Aug 26 03:08:17 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:17 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-90b56f14-cdbe-4505-ae99-e07ead81a256" returned: 0 in 0.369s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Lock "cinder-quobyte-90b56f14-cdbe-4505-ae99-e07ead81a256" released by "delete_volume" :: held 1.010s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Created reservations ['5e47364f-213e-4c05-8c7f-4fe00c1906aa', '83544178-5208-46f7-be23-d239df6186a6', 'fc3a5c1d-1e7a-4f7c-b0fb-d391622975fa', 'dc7b7dfd-cf22-45fa-a5dc-827eb6818dc5'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:17 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:08:17 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:18 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.471s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:18 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:18 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Deleted volume successfully. Aug 26 03:08:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-31ab7013-9439-4457-83ff-c31a9af8e817 tempest-VolumesTransfersV357Test-1111615632 None] Lock "cinder-90b56f14-cdbe-4505-ae99-e07ead81a256-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:24 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576" returned: 0 in 7.595s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:08:25 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Converted 1024.00 MB image at 134.80 MB/s Aug 26 03:08:25 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 is being set with open permissions: ugo+rw Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:25 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 Aug 26 03:08:25 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:25 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576" returned: 0 in 0.343s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-28859e9f-817e-49ee-a235-71889c8b3576" released by "_copy_volume_from_snapshot" :: held 9.266s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-85b8ef6d-38b9-4eda-b46c-5122d9970fdc-28859e9f-817e-49ee-a235-71889c8b3576" released by "_create_volume_from_snapshot" :: held 9.365s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.410s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6503f2e2-bef5-451b-9f80-be6407028566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28859e9f-817e-49ee-a235-71889c8b3576', 'volume_size': 2, 'snapshot_id': '85b8ef6d-38b9-4eda-b46c-5122d9970fdc'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffecb65-7427-43ab-8ba1-77d763957c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:25 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Volume volume-28859e9f-817e-49ee-a235-71889c8b3576 (28859e9f-817e-49ee-a235-71889c8b3576): created successfully Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffecb65-7427-43ab-8ba1-77d763957c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (95c70226-5cdc-4ff9-9bd3-4daedf85c38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:25 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-997a66c2-5043-4e14-b16e-7926f4b65f70 tempest-VolumesSnapshotTestJSON-319968539 None] Created volume successfully. Aug 26 03:08:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-28859e9f-817e-49ee-a235-71889c8b3576-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-28859e9f-817e-49ee-a235-71889c8b3576-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-28859e9f-817e-49ee-a235-71889c8b3576" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-28859e9f-817e-49ee-a235-71889c8b3576" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e17f1a-8762-4f4c-b9ec-50dd8d64b505]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:26 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 Aug 26 03:08:26 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:27 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576" returned: 0 in 0.460s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:27 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576 Aug 26 03:08:27 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:27 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-28859e9f-817e-49ee-a235-71889c8b3576" returned: 0 in 0.272s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-28859e9f-817e-49ee-a235-71889c8b3576" released by "delete_volume" :: held 0.792s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Created reservations ['d0d32771-1ace-4e66-bc47-d97ec902de4b', 'a2c8e9a1-804a-4fa6-b2e5-552c26928de6', '8553f6ce-b9e7-45d7-bc87-754c56fde37b', '48af837e-fd54-4761-b753-da7698a691bb'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:27 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:08:27 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-85b8ef6d-38b9-4eda-b46c-5122d9970fdc-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-85b8ef6d-38b9-4eda-b46c-5122d9970fdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-eae43cf1-0794-4593-96f5-faf769ac31ba" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-eae43cf1-0794-4593-96f5-faf769ac31ba" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-85b8ef6d-38b9-4eda-b46c-5122d9970fdc" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-85b8ef6d-38b9-4eda-b46c-5122d9970fdc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Deleting offline snapshot 85b8ef6d-38b9-4eda-b46c-5122d9970fdc of volume eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:08:27 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] snapshot_file for this snap is: volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:27 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Deleted volume successfully. Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5041e18-1dcd-47ae-85c0-7f1564c36025]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a8a677f1-c0f7-4a1c-bb9e-1480142c9a5f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-28859e9f-817e-49ee-a235-71889c8b3576-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:28 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc Aug 26 03:08:28 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:28 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc" returned: 0 in 0.417s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eae43cf1-0794-4593-96f5-faf769ac31ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:28 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f359c33-4884-40fd-abe1-9c25d82fa3ef]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:28 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba Aug 26 03:08:28 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:29 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba" returned: 0 in 0.613s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:29 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc Aug 26 03:08:29 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:29 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc" returned: 0 in 0.451s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:29 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc Aug 26 03:08:29 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:29 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba.85b8ef6d-38b9-4eda-b46c-5122d9970fdc" returned: 0 in 0.317s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=81,cinder:UPDATE=86,cinder:INSERT=21,cinder:DELETE=10 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-85b8ef6d-38b9-4eda-b46c-5122d9970fdc" released by "_delete_snapshot" :: held 1.961s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-eae43cf1-0794-4593-96f5-faf769ac31ba" released by "delete_snapshot" :: held 1.995s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:29 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Created reservations ['46732f07-fa23-4ec2-8c5e-3328e0f5e845', '5dc9117c-aca7-4bec-9c7b-08950df6232f', 'e6f9b583-365c-4a1e-abb8-f60443e78160', '592967da-5761-41ff-85b9-0c8598e47948'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Delete snapshot completed successfully. Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-25b2d6a9-9362-4363-8612-e65e6a9b40f5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-85b8ef6d-38b9-4eda-b46c-5122d9970fdc-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Flow 'volume_create_manager' (b72fe509-f3bc-4f76-aa39-8dd2d63941d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b30af-9e96-482d-8d38-9d4f1c83fb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b30af-9e96-482d-8d38-9d4f1c83fb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-501456670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358d17a1-4cf5-4e40-9c32-db286a5aba3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a525ea9ac686433e94ecb91e7d129eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:31Z,use_quota=True,user_id='6bb6717b1b5040d0b1a1ce177ca2fa9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3b28f3-e234-46c8-9a40-2981e03ebbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3b28f3-e234-46c8-9a40-2981e03ebbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d67aaf6-d67a-450c-8b97-eef40e9407fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d67aaf6-d67a-450c-8b97-eef40e9407fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358d17a1-4cf5-4e40-9c32-db286a5aba3f', 'volume_name': 'volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093ed975-be00-4ddf-a22e-d931600f1146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093ed975-be00-4ddf-a22e-d931600f1146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b87e410-09a4-4d6c-9b12-fca67e258c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Volume 358d17a1-4cf5-4e40-9c32-db286a5aba3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f', 'volume_size': 1} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-501456670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358d17a1-4cf5-4e40-9c32-db286a5aba3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a525ea9ac686433e94ecb91e7d129eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:31Z,use_quota=True,user_id='6bb6717b1b5040d0b1a1ce177ca2fa9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Creating volume 358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:30 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:08:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:30 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f 1073741824 Aug 26 03:08:30 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-eae43cf1-0794-4593-96f5-faf769ac31ba-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-eae43cf1-0794-4593-96f5-faf769ac31ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-eae43cf1-0794-4593-96f5-faf769ac31ba" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-eae43cf1-0794-4593-96f5-faf769ac31ba" acquired by "delete_volume" :: waited 0.030s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:31 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f 1073741824" returned: 0 in 0.575s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8f99bb-48c5-4f37-a725-94445dd541a6]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:31 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f Aug 26 03:08:31 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:31 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba Aug 26 03:08:31 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:31 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f" returned: 0 in 0.300s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b87e410-09a4-4d6c-9b12-fca67e258c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a21cd3d-cc4f-4e6d-9d01-f09d87452ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Volume volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f (358d17a1-4cf5-4e40-9c32-db286a5aba3f): created successfully Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a21cd3d-cc4f-4e6d-9d01-f09d87452ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:31 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Flow 'volume_create_manager' (b72fe509-f3bc-4f76-aa39-8dd2d63941d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba" returned: 0 in 0.419s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-55fcf119-535f-43ba-b848-6c7c85448e38 tempest-VolumesSnapshotListTestJSON-400194558 None] Created volume successfully. Aug 26 03:08:31 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba Aug 26 03:08:31 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:32 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eae43cf1-0794-4593-96f5-faf769ac31ba" returned: 0 in 0.281s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-eae43cf1-0794-4593-96f5-faf769ac31ba" released by "delete_volume" :: held 0.779s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Created reservations ['4041e972-5f96-4ae1-9f75-1f6ee4460a8e', '90db50d0-4e3d-488e-bfa1-c3b612541fa3', 'efb13af5-1360-4335-9c90-888d5c805488', 'b8ced9a2-e0b9-4297-ad6e-7223bfd7e3fb'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:32 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:08:32 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:32 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.306s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Deleted volume successfully. Aug 26 03:08:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-89113e27-100c-4d8f-aeb4-cb8a350c0569 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-eae43cf1-0794-4593-96f5-faf769ac31ba-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Creating offline snapshot d3f604a3-734d-4891-b46c-d6638f524e45 of volume 358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (008aacaa-cc27-4e1a-a130-f86c6d5a61bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681e2d65-bb15-46b3-ba7a-38b243f0f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a0968-0809-4bb9-8cce-55c98111f354]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681e2d65-bb15-46b3-ba7a-38b243f0f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-733915876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5618381-df2e-437f-a405-f115e4e98c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64aaa0bf9774d188a23bb21ef9874fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:33Z,use_quota=True,user_id='ba7330b2dc164005b1b58eb72f470916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a77f31-f3de-4bbf-9e46-35944878ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a77f31-f3de-4bbf-9e46-35944878ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96dfc808-ed37-4565-9631-94de631c1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96dfc808-ed37-4565-9631-94de631c1c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5618381-df2e-437f-a405-f115e4e98c08', 'volume_name': 'volume-f5618381-df2e-437f-a405-f115e4e98c08', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a6a592-0b0b-4a99-8db5-005b6c0377a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a6a592-0b0b-4a99-8db5-005b6c0377a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50d5891-13bf-4b88-9f16-b1922282789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:33 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Volume f5618381-df2e-437f-a405-f115e4e98c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5618381-df2e-437f-a405-f115e4e98c08', 'volume_size': 1} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:33 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f Aug 26 03:08:33 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:33 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f" returned: 0 in 0.463s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:33 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 1G Aug 26 03:08:33 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:34 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 1G" returned: 0 in 0.510s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:34 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 Aug 26 03:08:34 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:34 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45" returned: 0 in 0.407s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:34 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 is being set with open permissions: ugo+rw Aug 26 03:08:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:34 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 Aug 26 03:08:34 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:34 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45" returned: 0 in 0.331s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:35 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.info Aug 26 03:08:35 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:35 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.info" returned: 0 in 0.359s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:35 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.info is being set with open permissions: ugo+rw Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:35 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.info Aug 26 03:08:35 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:35 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.info" returned: 0 in 0.339s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.465s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-733915876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5618381-df2e-437f-a405-f115e4e98c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64aaa0bf9774d188a23bb21ef9874fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:33Z,use_quota=True,user_id='ba7330b2dc164005b1b58eb72f470916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Creating volume f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:35 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:08:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:35 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 1073741824 Aug 26 03:08:35 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:35 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0c4f39fd-af6f-41cb-83db-50976873a6f9 tempest-VolumesSnapshotListTestJSON-400194558 None] Create snapshot completed successfully Aug 26 03:08:36 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 1073741824" returned: 0 in 0.645s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:36 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 Aug 26 03:08:36 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:36 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08" returned: 0 in 0.303s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.315s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50d5891-13bf-4b88-9f16-b1922282789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5618381-df2e-437f-a405-f115e4e98c08', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6d987b-6822-45c5-8753-f9a6728a9ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Creating offline snapshot 8a264d19-6496-421e-8fa2-9c0c96b70fc0 of volume 358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:08:36 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Volume volume-f5618381-df2e-437f-a405-f115e4e98c08 (f5618381-df2e-437f-a405-f115e4e98c08): created successfully Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6d987b-6822-45c5-8753-f9a6728a9ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (008aacaa-cc27-4e1a-a130-f86c6d5a61bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4e5464-7f4b-4cfa-b398-a4b622bc9e2a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c4d3ff0f-35b0-43aa-9b51-4ce9788d202d tempest-VolumesSnapshotTestJSON-319968539 None] Created volume successfully. Aug 26 03:08:37 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 Aug 26 03:08:37 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:37 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45" returned: 0 in 0.494s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:37 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 1G Aug 26 03:08:37 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:37 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 1G" returned: 0 in 0.543s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:38 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 Aug 26 03:08:38 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:38 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0" returned: 0 in 0.346s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:38 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 is being set with open permissions: ugo+rw Aug 26 03:08:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:38 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 Aug 26 03:08:38 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:38 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0" returned: 0 in 0.287s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.040s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Creating offline snapshot 804d2fb3-c60e-47cc-82ad-6b79eed7ae9a of volume f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:08:38 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-dc695191-c327-48d6-8604-43e945f32360 tempest-VolumesSnapshotListTestJSON-400194558 None] Create snapshot completed successfully Aug 26 03:08:38 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a24b96-f1d1-450b-a2ee-cfd03b82b773]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:38 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 Aug 26 03:08:38 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:39 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08" returned: 0 in 0.406s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:39 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a 1G Aug 26 03:08:39 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:39 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a 1G" returned: 0 in 0.453s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5618381-df2e-437f-a405-f115e4e98c08 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:39 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5618381-df2e-437f-a405-f115e4e98c08 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a Aug 26 03:08:39 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:40 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5618381-df2e-437f-a405-f115e4e98c08 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" returned: 0 in 0.444s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:40 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a is being set with open permissions: ugo+rw Aug 26 03:08:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:40 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a Aug 26 03:08:40 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:40 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" returned: 0 in 0.317s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:40 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.info Aug 26 03:08:40 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:40 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.info" returned: 0 in 0.285s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:40 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.info is being set with open permissions: ugo+rw Aug 26 03:08:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:40 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.info Aug 26 03:08:40 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:40 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.info" returned: 0 in 0.300s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.020s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Creating offline snapshot f5a6d80d-f2f1-4aac-b507-819240c984b6 of volume 358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae6a2fc-cf3e-4d6a-bf6d-2358cc814916]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8b072614-f272-43f5-892a-9b27510b0eb5 tempest-VolumesSnapshotTestJSON-319968539 None] Create snapshot completed successfully Aug 26 03:08:41 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 Aug 26 03:08:41 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8a0a495b-63c8-491f-b8e6-ae5ac903a3d0 req-9c970f28-aa97-4e0e-a24b-8098a57b2bc9 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:41 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0" returned: 0 in 0.440s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:41 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 1G Aug 26 03:08:41 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:42 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 1G" returned: 0 in 0.527s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:42 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 Aug 26 03:08:42 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:42 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6" returned: 0 in 0.376s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:42 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 is being set with open permissions: ugo+rw Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:42 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:42 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (f61af77a-b86f-47e3-a775-93b9441c1b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ffedac1-0a5c-432d-b3f8-7c21d7ff05da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ffedac1-0a5c-432d-b3f8-7c21d7ff05da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-814438866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e995b1d-f6e9-41ea-a3e3-7b015d953c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64aaa0bf9774d188a23bb21ef9874fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=804d2fb3-c60e-47cc-82ad-6b79eed7ae9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:42Z,use_quota=True,user_id='ba7330b2dc164005b1b58eb72f470916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee792577-89ca-4614-8202-c28483423b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee792577-89ca-4614-8202-c28483423b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e184740-0dbd-44b9-a5f6-68582917dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e184740-0dbd-44b9-a5f6-68582917dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e995b1d-f6e9-41ea-a3e3-7b015d953c55', 'volume_name': 'volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55', 'volume_size': 1, 'snapshot_id': '804d2fb3-c60e-47cc-82ad-6b79eed7ae9a'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c07f2d6-da72-4dcf-b38e-2ecc23a6899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c07f2d6-da72-4dcf-b38e-2ecc23a6899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c46f4d-45f2-4cf9-9218-cfb9c825f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:42 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Volume 9e995b1d-f6e9-41ea-a3e3-7b015d953c55: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55', 'volume_size': 1, 'snapshot_id': '804d2fb3-c60e-47cc-82ad-6b79eed7ae9a'} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:42 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6" returned: 0 in 0.251s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.715s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8a0a495b-63c8-491f-b8e6-ae5ac903a3d0 req-9c970f28-aa97-4e0e-a24b-8098a57b2bc9 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.285s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-8a0a495b-63c8-491f-b8e6-ae5ac903a3d0 req-9c970f28-aa97-4e0e-a24b-8098a57b2bc9 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.144s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d9e140d8-9778-4c9b-8f98-d717d0974cc3 tempest-VolumesSnapshotListTestJSON-400194558 None] Create snapshot completed successfully Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Creating volume 9e995b1d-f6e9-41ea-a3e3-7b015d953c55 from snapshot 804d2fb3-c60e-47cc-82ad-6b79eed7ae9a {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] snapshot: 804d2fb3-c60e-47cc-82ad-6b79eed7ae9a, volume: 9e995b1d-f6e9-41ea-a3e3-7b015d953c55, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-8a0a495b-63c8-491f-b8e6-ae5ac903a3d0 req-9c970f28-aa97-4e0e-a24b-8098a57b2bc9 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-2180c191-bc34-4c0b-8853-b3872476f565', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96d5250d-d126-45a8-a496-2cbd77a0cc1f', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c75c826-59b2-44eb-9ed5-34be5f8f6e6f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-8a0a495b-63c8-491f-b8e6-ae5ac903a3d0 req-9c970f28-aa97-4e0e-a24b-8098a57b2bc9 tempest-TestServerVolumeAttachmentScenario-1883150438 None] attachment_update completed successfully. Aug 26 03:08:42 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a Aug 26 03:08:42 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:43 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" returned: 0 in 0.433s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5618381-df2e-437f-a405-f115e4e98c08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c5f36-34dd-45b7-9f21-b297d27f1b02]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:43 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 Aug 26 03:08:43 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:43 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08" returned: 0 in 0.501s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:08:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:43 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 Aug 26 03:08:43 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-f5a6d80d-f2f1-4aac-b507-819240c984b6-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-f5a6d80d-f2f1-4aac-b507-819240c984b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" acquired by "delete_snapshot" :: waited 0.063s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-quobyte-f5a6d80d-f2f1-4aac-b507-819240c984b6" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-f5a6d80d-f2f1-4aac-b507-819240c984b6" acquired by "_delete_snapshot" :: waited 0.079s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Deleting offline snapshot f5a6d80d-f2f1-4aac-b507-819240c984b6 of volume 358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] snapshot_file for this snap is: volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91a84cf-7f43-4ba8-bbc3-73044570c1dd]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:45 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 Aug 26 03:08:45 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:45 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6" returned: 0 in 1.219s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:46 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2291fc7-04a4-4a21-823f-1833c87f4b96]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:46 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 Aug 26 03:08:46 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:47 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0" returned: 0 in 1.091s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:47 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 Aug 26 03:08:47 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:48 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6" returned: 0 in 1.039s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:48 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6 Aug 26 03:08:48 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:48 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.f5a6d80d-f2f1-4aac-b507-819240c984b6" returned: 0 in 0.731s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-f5a6d80d-f2f1-4aac-b507-819240c984b6" released by "_delete_snapshot" :: held 4.405s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" released by "delete_snapshot" :: held 4.516s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:49 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" returned: 0 in 5.357s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:08:49 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Converted 1024.00 MB image at 191.07 MB/s Aug 26 03:08:49 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 is being set with open permissions: ugo+rw Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Created reservations ['c2f67fad-d570-48c2-8c55-168463b4aa84', '34aa4b42-7424-4683-b636-321fc9e50352', 'de3773fd-f83b-46c4-8b1a-c8e3a8828c5d', '3773bd8c-d1fd-460a-a04f-fda31faad33d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:49 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 Aug 26 03:08:49 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Delete snapshot completed successfully. Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-21d4da12-32fb-43b4-851c-d8885a14eadd tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-f5a6d80d-f2f1-4aac-b507-819240c984b6-delete_snapshot" released by "delete_snapshot" :: held 4.835s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:49 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" returned: 0 in 0.290s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" released by "_copy_volume_from_snapshot" :: held 6.680s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" released by "_create_volume_from_snapshot" :: held 6.761s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.785s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c46f4d-45f2-4cf9-9218-cfb9c825f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55', 'volume_size': 1, 'snapshot_id': '804d2fb3-c60e-47cc-82ad-6b79eed7ae9a'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb7fbe3-ddef-4172-bc2e-bf4a0a2d798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:49 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Volume volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 (9e995b1d-f6e9-41ea-a3e3-7b015d953c55): created successfully Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb7fbe3-ddef-4172-bc2e-bf4a0a2d798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Flow 'volume_create_manager' (f61af77a-b86f-47e3-a775-93b9441c1b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2c5f35a7-45f5-461b-93fa-e658296eaeb5 tempest-VolumesSnapshotTestJSON-319968539 None] Created volume successfully. Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-8a264d19-6496-421e-8fa2-9c0c96b70fc0-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-8a264d19-6496-421e-8fa2-9c0c96b70fc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-quobyte-8a264d19-6496-421e-8fa2-9c0c96b70fc0" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-8a264d19-6496-421e-8fa2-9c0c96b70fc0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Deleting offline snapshot 8a264d19-6496-421e-8fa2-9c0c96b70fc0 of volume 358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] snapshot_file for this snap is: volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca44e56f-898d-47a9-8b5d-ce1ca0b98557]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:50 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 Aug 26 03:08:50 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:50 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0" returned: 0 in 0.471s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[179ff770-58c0-4001-9410-bf05a38463ef]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:50 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 Aug 26 03:08:50 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-9e995b1d-f6e9-41ea-a3e3-7b015d953c55-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-9e995b1d-f6e9-41ea-a3e3-7b015d953c55-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ac3d4-b162-4ae9-b150-568dd58380d5]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d9c20467-1a2f-4a7a-be04-6e657fed45bc req-dfc7186d-12cd-4d7d-b74e-04d82c4fca2a tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d9c20467-1a2f-4a7a-be04-6e657fed45bc req-dfc7186d-12cd-4d7d-b74e-04d82c4fca2a tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d9c20467-1a2f-4a7a-be04-6e657fed45bc req-dfc7186d-12cd-4d7d-b74e-04d82c4fca2a tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:51 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 Aug 26 03:08:51 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-d9c20467-1a2f-4a7a-be04-6e657fed45bc req-dfc7186d-12cd-4d7d-b74e-04d82c4fca2a tempest-TestServerVolumeAttachmentScenario-1883150438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-03a90022-8579-4201-a16b-f7e56d139033', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f81e59d4-797e-40a9-abae-b2addd1b6dce', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:08:51 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45" returned: 0 in 0.573s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:51 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 Aug 26 03:08:51 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:51 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-d9c20467-1a2f-4a7a-be04-6e657fed45bc req-dfc7186d-12cd-4d7d-b74e-04d82c4fca2a tempest-TestServerVolumeAttachmentScenario-1883150438 None] attachment_update completed successfully. Aug 26 03:08:51 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" returned: 0 in 0.517s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:51 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55 Aug 26 03:08:51 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:51 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0" returned: 0 in 0.543s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:51 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0 Aug 26 03:08:51 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:51 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" returned: 0 in 0.401s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-9e995b1d-f6e9-41ea-a3e3-7b015d953c55" released by "delete_volume" :: held 0.981s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Created reservations ['f44bad01-6345-4812-844f-8a838c2a60be', '45cafa36-d927-4e66-9f62-12c7a91fec1b', 'c5c937ff-9053-49fd-adbc-146f1da2ea2d', '6ec55583-ac9d-4fbb-a1fa-dab48fb4b431'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:52 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:08:52 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:52 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.8a264d19-6496-421e-8fa2-9c0c96b70fc0" returned: 0 in 0.428s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-8a264d19-6496-421e-8fa2-9c0c96b70fc0" released by "_delete_snapshot" :: held 2.162s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" released by "delete_snapshot" :: held 2.192s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Created reservations ['49b137fb-d5a4-4c8f-8629-8880a5753b7a', '41ca84f7-5760-4556-b454-f972f7bdb69b', 'dcb04506-0fae-4ab7-901e-49030d2b499e', 'c99be50b-6402-465c-be75-75c670c87c11'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Delete snapshot completed successfully. Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8e94a0c7-b236-4fcc-87b4-1d892afc0399 tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-8a264d19-6496-421e-8fa2-9c0c96b70fc0-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:52 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.306s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Deleted volume successfully. Aug 26 03:08:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-56f81267-92ec-43ac-acce-1908c6f41e0f tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-9e995b1d-f6e9-41ea-a3e3-7b015d953c55-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-d3f604a3-734d-4891-b46c-d6638f524e45-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-d3f604a3-734d-4891-b46c-d6638f524e45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-quobyte-d3f604a3-734d-4891-b46c-d6638f524e45" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-f5618381-df2e-437f-a405-f115e4e98c08" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-d3f604a3-734d-4891-b46c-d6638f524e45" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Deleting offline snapshot d3f604a3-734d-4891-b46c-d6638f524e45 of volume 358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] snapshot_file for this snap is: volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-f5618381-df2e-437f-a405-f115e4e98c08" acquired by "delete_snapshot" :: waited 0.088s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a33ad9-5128-4aef-8adc-24ea36eeb174]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Deleting offline snapshot 804d2fb3-c60e-47cc-82ad-6b79eed7ae9a of volume f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] snapshot_file for this snap is: volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a0777f-43c0-42b2-a8af-4de193347d4f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:53 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 Aug 26 03:08:53 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:53 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a Aug 26 03:08:53 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:53 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45" returned: 0 in 0.443s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:53 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" returned: 0 in 0.412s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5618381-df2e-437f-a405-f115e4e98c08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf2f070-b0a5-4a52-9af5-b45f4138d8b7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[421974cf-8bc6-48f5-8fff-80d0d10bba51]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-fd33b018-01c4-4ce8-89eb-ef87fe1432c1 req-4b6db3ba-6875-4b58-9fcb-77b526c50f55 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Terminate volume connection completed successfully. Aug 26 03:08:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-fd33b018-01c4-4ce8-89eb-ef87fe1432c1 req-4b6db3ba-6875-4b58-9fcb-77b526c50f55 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Deleting attachment f81e59d4-797e-40a9-abae-b2addd1b6dce. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:08:54 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 Aug 26 03:08:54 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:54 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f Aug 26 03:08:54 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:54 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f" returned: 0 in 0.434s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:54 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 Aug 26 03:08:54 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:54 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08" returned: 0 in 0.671s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:54 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a Aug 26 03:08:54 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:54 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45" returned: 0 in 0.438s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:54 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45 Aug 26 03:08:54 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:55 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" returned: 0 in 0.475s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:55 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a Aug 26 03:08:55 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:55 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f.d3f604a3-734d-4891-b46c-d6638f524e45" returned: 0 in 0.345s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-d3f604a3-734d-4891-b46c-d6638f524e45" released by "_delete_snapshot" :: held 1.862s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" released by "delete_snapshot" :: held 1.924s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Created reservations ['fa81c262-4400-47c7-80f4-639a713f0ba4', '8e208293-4783-4a46-a5bd-068e6e71a620', '0667367e-dfae-42fe-8b2a-7327953ffd84', '563b219b-d6c4-487c-ae01-c1364390dbaa'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:55 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Delete snapshot completed successfully. Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c1013bce-c2fa-45a2-ac0a-318d3c6e9f0b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-d3f604a3-734d-4891-b46c-d6638f524e45-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:55 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08.804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" returned: 0 in 0.363s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a" released by "_delete_snapshot" :: held 2.065s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-f5618381-df2e-437f-a405-f115e4e98c08" released by "delete_snapshot" :: held 2.114s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-358d17a1-4cf5-4e40-9c32-db286a5aba3f-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-358d17a1-4cf5-4e40-9c32-db286a5aba3f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Created reservations ['c0b3b9af-ebcf-4a81-9f26-b55a8567f059', '5c8c0039-1a34-4c01-a7c3-82e68d40bfd0', 'b5a2afd4-1522-4195-ac25-f83bdd5aca88', 'b2af8917-5c66-4755-b1ae-69aa049d91ee'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6329ba5-0317-4216-9a19-003c8c085961]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:55 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-896158ce-1cbd-48f6-9f64-7610bbf75a38 req-b4053ab6-fb8b-4d1f-9fab-d688626381eb tempest-TestServerVolumeAttachmentScenario-1883150438 None] Terminate volume connection completed successfully. Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-896158ce-1cbd-48f6-9f64-7610bbf75a38 req-b4053ab6-fb8b-4d1f-9fab-d688626381eb tempest-TestServerVolumeAttachmentScenario-1883150438 None] Deleting attachment 96d5250d-d126-45a8-a496-2cbd77a0cc1f. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:08:55 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Delete snapshot completed successfully. Aug 26 03:08:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-51ae48b8-c142-46b9-bcb2-94b22b2112a4 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-804d2fb3-c60e-47cc-82ad-6b79eed7ae9a-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:55 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f Aug 26 03:08:55 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:56 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f" returned: 0 in 0.411s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:56 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f Aug 26 03:08:56 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:56 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-358d17a1-4cf5-4e40-9c32-db286a5aba3f" returned: 0 in 0.305s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-quobyte-358d17a1-4cf5-4e40-9c32-db286a5aba3f" released by "delete_volume" :: held 0.833s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Created reservations ['eb34be20-8cb7-4075-b4f0-af82a5e74b6a', '387cfc2e-a4d7-4998-ace4-021c3051ec13', 'c6318030-37b0-4e6b-a420-150ccbc039ee', '1283f3e2-5bb1-4cad-bf99-ea94dbae91a3'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-f5618381-df2e-437f-a405-f115e4e98c08-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-f5618381-df2e-437f-a405-f115e4e98c08-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-f5618381-df2e-437f-a405-f115e4e98c08" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:56 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:08:56 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-f5618381-df2e-437f-a405-f115e4e98c08" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c71cd83-e296-4aaa-b496-6bbaf43bd7f0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:57 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 Aug 26 03:08:57 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:57 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.493s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:57 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:57 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Deleted volume successfully. Aug 26 03:08:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-eae671ad-5a60-4eb0-a868-cfbb5bf0e20b tempest-VolumesSnapshotListTestJSON-400194558 None] Lock "cinder-358d17a1-4cf5-4e40-9c32-db286a5aba3f-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:57 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08" returned: 0 in 0.705s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:57 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08 Aug 26 03:08:57 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:58 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f5618381-df2e-437f-a405-f115e4e98c08" returned: 0 in 0.375s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-f5618381-df2e-437f-a405-f115e4e98c08" released by "delete_volume" :: held 1.179s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Created reservations ['e2f8c2e7-8c6f-40c1-929f-7e7f18312ddb', '0513b032-366a-412a-90a2-8646c3df2206', 'c1440f23-320c-4e0d-9f72-ccbb183b5e76', '9e9356dd-29a0-4213-bbb9-c71e65b8bae0'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:58 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:08:58 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:58 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Deleted volume successfully. Aug 26 03:08:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-015efa4e-67e4-4edc-82c1-f2f075e077a3 tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-f5618381-df2e-437f-a405-f115e4e98c08-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-bd03787b-f6cb-4290-919e-04840d25e906-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-bd03787b-f6cb-4290-919e-04840d25e906-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "cinder-quobyte-bd03787b-f6cb-4290-919e-04840d25e906" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-bd03787b-f6cb-4290-919e-04840d25e906" acquired by "delete_volume" :: waited 0.044s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:59 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc42be7-4ae2-4eb1-8549-9227b216a270]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:59 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 Aug 26 03:08:59 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:59 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906" returned: 0 in 0.496s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:59 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906 Aug 26 03:08:59 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:00 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bd03787b-f6cb-4290-919e-04840d25e906" returned: 0 in 0.308s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-quobyte-bd03787b-f6cb-4290-919e-04840d25e906" released by "delete_volume" :: held 0.909s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Created reservations ['ca9afd8d-d482-42c0-beb8-e99b07742dec', '7df036c7-219d-43d1-a296-0ad691761683', '1d8439a4-8a20-41ec-86f0-5fee29ae12bb', '46744113-f73c-4524-8c79-cc4274a85dae'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:00 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:00 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:00 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.381s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Deleted volume successfully. Aug 26 03:09:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-15c55941-e98e-4640-ba6b-98cfb22de71e tempest-VolumesSnapshotTestJSON-319968539 None] Lock "cinder-bd03787b-f6cb-4290-919e-04840d25e906-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:01 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Flow 'volume_create_manager' (3d314f2b-f6a3-4191-ba7a-bf1eb53ab9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666accf7-e0df-4bbc-b202-2ea4f35a92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666accf7-e0df-4bbc-b202-2ea4f35a92de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-125271901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd56dac-7939-4c63-a367-cba716d00d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9778b9b89a45e7960a5347fc61e530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:02Z,use_quota=True,user_id='cd66f8c41e7c4154b174d64ccf75cbb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fab49d9-3c3b-483f-9784-b3f440ad0abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fab49d9-3c3b-483f-9784-b3f440ad0abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9aef83d-84a3-4c09-9354-98742087dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9aef83d-84a3-4c09-9354-98742087dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd56dac-7939-4c63-a367-cba716d00d11', 'volume_name': 'volume-0fd56dac-7939-4c63-a367-cba716d00d11', 'volume_size': 2}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63c5acc-02c9-4e46-bb4b-e686fa58d02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63c5acc-02c9-4e46-bb4b-e686fa58d02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83079aea-9621-4f30-84fc-c756efa01caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:02 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Volume 0fd56dac-7939-4c63-a367-cba716d00d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd56dac-7939-4c63-a367-cba716d00d11', 'volume_size': 2} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-125271901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd56dac-7939-4c63-a367-cba716d00d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9778b9b89a45e7960a5347fc61e530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:02Z,use_quota=True,user_id='cd66f8c41e7c4154b174d64ccf75cbb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Creating volume 0fd56dac-7939-4c63-a367-cba716d00d11 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:02 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 2147483648 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:02 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 2147483648 Aug 26 03:09:02 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "cinder-03a90022-8579-4201-a16b-f7e56d139033-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:02 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:02 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "cinder-03a90022-8579-4201-a16b-f7e56d139033-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "cinder-quobyte-03a90022-8579-4201-a16b-f7e56d139033" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "cinder-quobyte-03a90022-8579-4201-a16b-f7e56d139033" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e69109-f8d0-48b4-8bdd-0071253fda84]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:02 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 Aug 26 03:09:02 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:02 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.395s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:09:02 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033" returned: 0 in 0.554s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:02 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 2147483648" returned: 0 in 0.751s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:02 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033 Aug 26 03:09:02 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:02 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 Aug 26 03:09:02 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:03 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-03a90022-8579-4201-a16b-f7e56d139033" returned: 0 in 0.357s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "cinder-quobyte-03a90022-8579-4201-a16b-f7e56d139033" released by "delete_volume" :: held 0.974s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:03 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11" returned: 0 in 0.322s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83079aea-9621-4f30-84fc-c756efa01caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd56dac-7939-4c63-a367-cba716d00d11', 'volume_size': 2}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e2aea0-2562-4fe7-a155-cfae45742f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:03 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Volume volume-0fd56dac-7939-4c63-a367-cba716d00d11 (0fd56dac-7939-4c63-a367-cba716d00d11): created successfully Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e2aea0-2562-4fe7-a155-cfae45742f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Flow 'volume_create_manager' (3d314f2b-f6a3-4191-ba7a-bf1eb53ab9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-19f5b50b-62b4-40d5-afb7-34aaf91360b5 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Created volume successfully. Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Created reservations ['6e3a9b10-d4b3-44eb-9872-752e876a51ad', 'a0cba413-5726-4474-b75c-519fbb4745a0', '7911731e-8cd2-48b8-9359-ad976e31354f', 'e527a60f-e3c9-4bb3-a75a-657c06272915'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:03 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:03 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:03 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.307s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Deleted volume successfully. Aug 26 03:09:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-cd736599-43ab-4e03-8e6c-9ac7c5a1a658 tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "cinder-03a90022-8579-4201-a16b-f7e56d139033-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Creating offline snapshot cea7f848-7951-4ae6-a0df-55077b679713 of volume 0fd56dac-7939-4c63-a367-cba716d00d11 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffa9176-4419-42fa-9008-65c14a0dc389]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "cinder-2180c191-bc34-4c0b-8853-b3872476f565-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "cinder-2180c191-bc34-4c0b-8853-b3872476f565-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "cinder-quobyte-2180c191-bc34-4c0b-8853-b3872476f565" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "cinder-quobyte-2180c191-bc34-4c0b-8853-b3872476f565" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:04 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 Aug 26 03:09:04 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f065d89-cd23-47a8-a7b2-150f892aaa4f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:04 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 Aug 26 03:09:04 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:04 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11" returned: 0 in 0.455s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 2G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:04 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 2G Aug 26 03:09:04 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:04 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565" returned: 0 in 0.473s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:04 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565 Aug 26 03:09:04 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:05 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2180c191-bc34-4c0b-8853-b3872476f565" returned: 0 in 0.304s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:05 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 2G" returned: 0 in 0.509s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd56dac-7939-4c63-a367-cba716d00d11 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "cinder-quobyte-2180c191-bc34-4c0b-8853-b3872476f565" released by "delete_volume" :: held 0.835s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:05 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd56dac-7939-4c63-a367-cba716d00d11 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 Aug 26 03:09:05 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Created reservations ['d75301d1-148c-498f-b746-1075cc318f58', '126b3274-c1f7-4fc5-8577-db43d6b2f278', 'f0ebe912-cea2-4de7-9642-4feb8e6294b9', '6b64e0cc-3f06-4cdb-89e5-17246289dbb8'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:05 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:05 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:05 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd56dac-7939-4c63-a367-cba716d00d11 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:05 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 is being set with open permissions: ugo+rw Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:05 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 Aug 26 03:09:05 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:05 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.395s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:05 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Deleted volume successfully. Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0dd775df-412d-4243-bc1a-b5f4da618d1f tempest-TestServerVolumeAttachmentScenario-1883150438 None] Lock "cinder-2180c191-bc34-4c0b-8853-b3872476f565-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:05 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713" returned: 0 in 0.364s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:06 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.info Aug 26 03:09:06 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:06 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.info" returned: 0 in 0.358s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:06 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.info is being set with open permissions: ugo+rw Aug 26 03:09:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:06 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.info Aug 26 03:09:06 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:06 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.info" returned: 0 in 0.326s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f4d12600-e764-42c3-ae87-f0a8fefdd110 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Create snapshot completed successfully Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "cinder-cea7f848-7951-4ae6-a0df-55077b679713-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-cea7f848-7951-4ae6-a0df-55077b679713-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "cinder-quobyte-0fd56dac-7939-4c63-a367-cba716d00d11" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-quobyte-0fd56dac-7939-4c63-a367-cba716d00d11" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "cinder-quobyte-cea7f848-7951-4ae6-a0df-55077b679713" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-quobyte-cea7f848-7951-4ae6-a0df-55077b679713" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Deleting offline snapshot cea7f848-7951-4ae6-a0df-55077b679713 of volume 0fd56dac-7939-4c63-a367-cba716d00d11 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] snapshot_file for this snap is: volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd38a1d3-2fab-435a-8082-dab570931835]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:07 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 Aug 26 03:09:07 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:08 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713" returned: 0 in 0.460s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd56dac-7939-4c63-a367-cba716d00d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:09:08 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3fe81-cea1-4b6f-8e80-76561a63d54c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:08 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 Aug 26 03:09:08 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:08 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11" returned: 0 in 0.476s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:08 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 Aug 26 03:09:08 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:09 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713" returned: 0 in 0.453s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:09 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713 Aug 26 03:09:09 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:09 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11.cea7f848-7951-4ae6-a0df-55077b679713" returned: 0 in 0.381s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-quobyte-cea7f848-7951-4ae6-a0df-55077b679713" released by "_delete_snapshot" :: held 1.912s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-quobyte-0fd56dac-7939-4c63-a367-cba716d00d11" released by "delete_snapshot" :: held 1.948s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Created reservations ['4c28560b-fbfd-4036-aac7-948c7767e7ec', '5abc419e-1269-4198-8595-9a2b15268e2a', 'd80dc1d2-2a3e-4e80-99af-b2e0d58550b3', '6756a802-e53e-43a7-877f-90cd577060cc'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Delete snapshot completed successfully. Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-26ff1616-f52a-4be1-b949-d28e127599e6 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-cea7f848-7951-4ae6-a0df-55077b679713-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "cinder-0fd56dac-7939-4c63-a367-cba716d00d11-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-0fd56dac-7939-4c63-a367-cba716d00d11-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "cinder-quobyte-0fd56dac-7939-4c63-a367-cba716d00d11" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-quobyte-0fd56dac-7939-4c63-a367-cba716d00d11" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ab1243-3756-421d-8796-b327217f8348]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:10 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 Aug 26 03:09:10 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:10 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11" returned: 0 in 0.595s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:10 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11 Aug 26 03:09:10 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:10 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0fd56dac-7939-4c63-a367-cba716d00d11" returned: 0 in 0.361s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-quobyte-0fd56dac-7939-4c63-a367-cba716d00d11" released by "delete_volume" :: held 1.038s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:10 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=137,cinder:SELECT=129,cinder:INSERT=43,cinder:DELETE=12 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Created reservations ['ccfa3454-80cd-49ff-998b-0c1164ef41a9', '66c6723b-8c40-4f46-a534-e2bddbf74dfb', 'bc61afe6-82e7-4679-a3bd-1084e2ce9046', '385e1995-6392-4965-99f1-6c2dbfffa445'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:11 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:11 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:11 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.316s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Deleted volume successfully. Aug 26 03:09:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ef2899dc-8820-4adf-8df5-e65a146411c4 tempest-VolumesSnapshotNegativeTestJSON-1333442062 None] Lock "cinder-0fd56dac-7939-4c63-a367-cba716d00d11-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (a26f7985-9f39-451d-8a50-271de04b7cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b33b48-e9bf-481c-9c8d-1515d5c9bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b33b48-e9bf-481c-9c8d-1515d5c9bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-775247943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1f5f02-2030-4e5d-ab12-2e7b115e6577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:25Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e37ec14-c003-4f2b-890d-942b7bfd8bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e37ec14-c003-4f2b-890d-942b7bfd8bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47acf323-9fdb-496e-9762-bf4d8771373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47acf323-9fdb-496e-9762-bf4d8771373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c1f5f02-2030-4e5d-ab12-2e7b115e6577', 'volume_name': 'volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894f8e87-adb5-47b3-aad4-50eaec34b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894f8e87-adb5-47b3-aad4-50eaec34b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476cdb73-fdb5-449a-91bb-b19880230672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:25 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Volume 8c1f5f02-2030-4e5d-ab12-2e7b115e6577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577', 'volume_size': 1} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-775247943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1f5f02-2030-4e5d-ab12-2e7b115e6577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:25Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Creating volume 8c1f5f02-2030-4e5d-ab12-2e7b115e6577 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:25 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:25 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 1073741824 Aug 26 03:09:25 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (cbf3ee14-ca89-4e74-8a8e-42ad824b62c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0807f4fe-0249-4a4e-b517-496acae7d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0807f4fe-0249-4a4e-b517-496acae7d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-406795573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa784e56-db71-404b-ba43-2988a9b3f09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:26Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d40344-7612-404a-88d0-b66efd339a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d40344-7612-404a-88d0-b66efd339a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3cbd9a-acb4-4c7b-b592-6403fa850f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3cbd9a-acb4-4c7b-b592-6403fa850f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa784e56-db71-404b-ba43-2988a9b3f09a', 'volume_name': 'volume-fa784e56-db71-404b-ba43-2988a9b3f09a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b5b529-3e08-4274-95fb-21e1de18a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b5b529-3e08-4274-95fb-21e1de18a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1955320-eab9-4d8e-97d8-6fc5e893fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Volume fa784e56-db71-404b-ba43-2988a9b3f09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa784e56-db71-404b-ba43-2988a9b3f09a', 'volume_size': 1} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:26 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 1073741824" returned: 0 in 0.900s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:26 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 Aug 26 03:09:26 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (e37cdfe2-1fa2-4ba1-b61c-de4201ea085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f99a36-d577-426d-88e4-451c304b9908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f99a36-d577-426d-88e4-451c304b9908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136516282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77be31f1-0a10-4707-a8ea-1f50c562a1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:27Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a1d0ed-f428-4d18-ae04-b3400199c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a1d0ed-f428-4d18-ae04-b3400199c6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2082c98e-b5ca-4ebc-92b2-162fc29f6c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2082c98e-b5ca-4ebc-92b2-162fc29f6c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77be31f1-0a10-4707-a8ea-1f50c562a1a5', 'volume_name': 'volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e80b883-a9f5-4caf-a40c-95e1ee25c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e80b883-a9f5-4caf-a40c-95e1ee25c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4344ea5-daf8-4c14-91f3-4114ff9a1533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Volume 77be31f1-0a10-4707-a8ea-1f50c562a1a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5', 'volume_size': 1} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:26 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577" returned: 0 in 0.533s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.938s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-406795573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa784e56-db71-404b-ba43-2988a9b3f09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:26Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Creating volume fa784e56-db71-404b-ba43-2988a9b3f09a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:27 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:27 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a 1073741824 Aug 26 03:09:27 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476cdb73-fdb5-449a-91bb-b19880230672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b656192-a253-476a-9f97-e7f7b466d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:27 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Volume volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 (8c1f5f02-2030-4e5d-ab12-2e7b115e6577): created successfully Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b656192-a253-476a-9f97-e7f7b466d996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (a26f7985-9f39-451d-8a50-271de04b7cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:27 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-99b7c3c9-f115-4a6d-826a-bae73fd391cd tempest-CreateVolumesFromImageTest-674083925 None] Created volume successfully. Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (85b7a6b8-b118-44d8-a595-d2346297b5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd4f7c1-b8d0-4a9f-9d45-fb307694de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd4f7c1-b8d0-4a9f-9d45-fb307694de18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855938645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c2fc69-da76-4318-a0da-5dc00261af0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:27Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d78b960-44f8-4c87-9a9b-bca9065e47e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d78b960-44f8-4c87-9a9b-bca9065e47e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44304f35-da7c-4344-bd0c-1587c3349339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44304f35-da7c-4344-bd0c-1587c3349339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c2fc69-da76-4318-a0da-5dc00261af0e', 'volume_name': 'volume-b3c2fc69-da76-4318-a0da-5dc00261af0e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a25060-2f13-4e66-b16c-24f82e0beb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a25060-2f13-4e66-b16c-24f82e0beb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea84150f-04ff-43ce-96fd-85fa1bb4539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:27 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Volume b3c2fc69-da76-4318-a0da-5dc00261af0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c2fc69-da76-4318-a0da-5dc00261af0e', 'volume_size': 1} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:27 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a 1073741824" returned: 0 in 0.905s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (af39dfa5-827d-47df-8710-e25fa1416952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a46cf20-ec89-4f7d-a1b6-371c3c2e54e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a46cf20-ec89-4f7d-a1b6-371c3c2e54e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-19007240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc70993-f989-4ae3-9ec7-70224901ba2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:28Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0324937-de19-4c98-bb1a-0eb6446d067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0324937-de19-4c98-bb1a-0eb6446d067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b41d59-c28b-4196-9292-b7ec3dae1a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b41d59-c28b-4196-9292-b7ec3dae1a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc70993-f989-4ae3-9ec7-70224901ba2a', 'volume_name': 'volume-7bc70993-f989-4ae3-9ec7-70224901ba2a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a71adb-f894-48c3-8f2c-fabfb49a9f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a71adb-f894-48c3-8f2c-fabfb49a9f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e238b19-f697-4d0c-8c0b-c0f48b1f6601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Volume 7bc70993-f989-4ae3-9ec7-70224901ba2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc70993-f989-4ae3-9ec7-70224901ba2a', 'volume_size': 1} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:28 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a Aug 26 03:09:28 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:28 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a" returned: 0 in 0.371s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.566s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136516282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77be31f1-0a10-4707-a8ea-1f50c562a1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:27Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Creating volume 77be31f1-0a10-4707-a8ea-1f50c562a1a5 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:28 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:28 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 1073741824 Aug 26 03:09:28 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1955320-eab9-4d8e-97d8-6fc5e893fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa784e56-db71-404b-ba43-2988a9b3f09a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2d3448-f80a-4a26-b84c-8ffe39f9c8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Volume volume-fa784e56-db71-404b-ba43-2988a9b3f09a (fa784e56-db71-404b-ba43-2988a9b3f09a): created successfully Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2d3448-f80a-4a26-b84c-8ffe39f9c8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (cbf3ee14-ca89-4e74-8a8e-42ad824b62c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-162df80e-e4cd-4d19-855f-9d694ae1ad45 tempest-CreateVolumesFromImageTest-674083925 None] Created volume successfully. Aug 26 03:09:29 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 1073741824" returned: 0 in 0.634s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:29 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 Aug 26 03:09:29 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:29 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5" returned: 0 in 0.277s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855938645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c2fc69-da76-4318-a0da-5dc00261af0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:27Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Creating volume b3c2fc69-da76-4318-a0da-5dc00261af0e {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:29 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4344ea5-daf8-4c14-91f3-4114ff9a1533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d70e023-b896-453a-bd35-d22fc7affe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:29 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e 1073741824 Aug 26 03:09:29 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:29 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Volume volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 (77be31f1-0a10-4707-a8ea-1f50c562a1a5): created successfully Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d70e023-b896-453a-bd35-d22fc7affe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (e37cdfe2-1fa2-4ba1-b61c-de4201ea085b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-bb270c28-4602-4896-80ae-4777a471e0d1 tempest-CreateVolumesFromImageTest-674083925 None] Created volume successfully. Aug 26 03:09:30 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e 1073741824" returned: 0 in 0.754s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:INSERT=29,cinder:UPDATE=131,cinder:SELECT=128,cinder:DELETE=8 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:30 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e Aug 26 03:09:30 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:30 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e" returned: 0 in 0.462s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.692s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-19007240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc70993-f989-4ae3-9ec7-70224901ba2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b1d269c6d4cd4b8da07bbe03547b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:28Z,use_quota=True,user_id='5ab5049857da42529d07849321ee6d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Creating volume 7bc70993-f989-4ae3-9ec7-70224901ba2a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:30 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea84150f-04ff-43ce-96fd-85fa1bb4539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c2fc69-da76-4318-a0da-5dc00261af0e', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:30 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a 1073741824 Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584cbeb6-8492-48c1-942a-065452591e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:30 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Volume volume-b3c2fc69-da76-4318-a0da-5dc00261af0e (b3c2fc69-da76-4318-a0da-5dc00261af0e): created successfully Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584cbeb6-8492-48c1-942a-065452591e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (85b7a6b8-b118-44d8-a595-d2346297b5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0a529da9-6945-42ba-a320-36de0a635c81 tempest-CreateVolumesFromImageTest-674083925 None] Created volume successfully. Aug 26 03:09:31 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a 1073741824" returned: 0 in 0.729s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:31 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a Aug 26 03:09:31 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:31 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a" returned: 0 in 0.325s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e238b19-f697-4d0c-8c0b-c0f48b1f6601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc70993-f989-4ae3-9ec7-70224901ba2a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ad9dee-2d5a-4904-a933-3b5e3408c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Volume volume-7bc70993-f989-4ae3-9ec7-70224901ba2a (7bc70993-f989-4ae3-9ec7-70224901ba2a): created successfully Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ad9dee-2d5a-4904-a933-3b5e3408c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Flow 'volume_create_manager' (af39dfa5-827d-47df-8710-e25fa1416952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e91027aa-962a-4474-a20b-54bbbc12a50b tempest-CreateVolumesFromImageTest-674083925 None] Created volume successfully. Aug 26 03:09:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-7bc70993-f989-4ae3-9ec7-70224901ba2a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-7bc70993-f989-4ae3-9ec7-70224901ba2a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-quobyte-7bc70993-f989-4ae3-9ec7-70224901ba2a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-7bc70993-f989-4ae3-9ec7-70224901ba2a" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:32 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[44008817-39a8-423d-8597-b480d12b4a0d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:32 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a Aug 26 03:09:32 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:33 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a" returned: 0 in 0.628s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:33 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a Aug 26 03:09:33 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:33 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7bc70993-f989-4ae3-9ec7-70224901ba2a" returned: 0 in 0.368s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-7bc70993-f989-4ae3-9ec7-70224901ba2a" released by "delete_volume" :: held 1.079s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Created reservations ['0fd79cfd-5748-41f1-88ac-f8feea360503', '63e88463-e6f4-4b27-8466-c118e9ae8ce3', 'dbff802d-d999-4cf9-bda4-680df04715b0', '41b05f6c-4d8f-4b8a-a3ec-deab1e7043be'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:34 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:34 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:34 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.361s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:34 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:34 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Deleted volume successfully. Aug 26 03:09:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-533348bc-165d-4567-b169-61f3b7856e80 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-7bc70993-f989-4ae3-9ec7-70224901ba2a-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-b3c2fc69-da76-4318-a0da-5dc00261af0e-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-b3c2fc69-da76-4318-a0da-5dc00261af0e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-quobyte-b3c2fc69-da76-4318-a0da-5dc00261af0e" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-b3c2fc69-da76-4318-a0da-5dc00261af0e" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:35 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[694e63b4-5f7e-4cfa-98e9-dd21c2e65b13]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:35 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e Aug 26 03:09:35 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:35 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e" returned: 0 in 0.462s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:35 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e Aug 26 03:09:35 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:35 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b3c2fc69-da76-4318-a0da-5dc00261af0e" returned: 0 in 0.345s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-b3c2fc69-da76-4318-a0da-5dc00261af0e" released by "delete_volume" :: held 0.869s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Created reservations ['d90da628-806d-4dee-93fa-c5d7e7f64d73', '130c07a5-6eac-4b75-a219-882e4ef440aa', '0cd55c27-f7e1-44b6-8d54-2546a631c0b3', '634b8c78-3948-41e6-9441-c517a1f30be9'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:36 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:36 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-77be31f1-0a10-4707-a8ea-1f50c562a1a5-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-77be31f1-0a10-4707-a8ea-1f50c562a1a5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-quobyte-77be31f1-0a10-4707-a8ea-1f50c562a1a5" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-77be31f1-0a10-4707-a8ea-1f50c562a1a5" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd5be9e-a459-422b-b5aa-a229674d5d81]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:36 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 Aug 26 03:09:36 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:36 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.636s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Deleted volume successfully. Aug 26 03:09:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b63eca33-8dd6-453e-8304-c38d15836be9 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-b3c2fc69-da76-4318-a0da-5dc00261af0e-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:37 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5" returned: 0 in 0.663s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:37 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5 Aug 26 03:09:37 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:37 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-77be31f1-0a10-4707-a8ea-1f50c562a1a5" returned: 0 in 0.389s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-77be31f1-0a10-4707-a8ea-1f50c562a1a5" released by "delete_volume" :: held 1.153s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Created reservations ['6be85104-8d42-4dea-a4ab-79bbd9088fe3', '4862b6f6-cda5-4c8a-afaa-c75a2de93303', 'b443813f-160e-4c7c-923c-598b888e4921', '996b0951-86f3-4e4a-b8de-fb52054a2368'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:37 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:37 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:38 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.333s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:38 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Deleted volume successfully. Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-30d579e1-94bc-4c43-ad4c-541b11777259 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-77be31f1-0a10-4707-a8ea-1f50c562a1a5-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-fa784e56-db71-404b-ba43-2988a9b3f09a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-fa784e56-db71-404b-ba43-2988a9b3f09a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-quobyte-fa784e56-db71-404b-ba43-2988a9b3f09a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-fa784e56-db71-404b-ba43-2988a9b3f09a" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f16039-0730-4e85-b42f-daa05605be3a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:38 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a Aug 26 03:09:38 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:39 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a" returned: 0 in 0.452s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:39 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a Aug 26 03:09:39 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:39 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-fa784e56-db71-404b-ba43-2988a9b3f09a" returned: 0 in 0.281s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-fa784e56-db71-404b-ba43-2988a9b3f09a" released by "delete_volume" :: held 0.790s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Created reservations ['7a152b17-bd9a-4cca-a8c9-6aa870ea58be', '6a57dd96-58ae-4ceb-986b-d86fc9571804', '044a19a9-80a1-42bc-9fb4-55fbff19a57b', 'bff5fe0e-d5c9-4fa7-87b6-650ffc41d117'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:39 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:39 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-8c1f5f02-2030-4e5d-ab12-2e7b115e6577-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-8c1f5f02-2030-4e5d-ab12-2e7b115e6577-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "cinder-quobyte-8c1f5f02-2030-4e5d-ab12-2e7b115e6577" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:40 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.335s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:40 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Deleted volume successfully. Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-8c1f5f02-2030-4e5d-ab12-2e7b115e6577" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-727dc2d1-6cc6-44de-bf7e-82578016c25d tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-fa784e56-db71-404b-ba43-2988a9b3f09a-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[46272e43-d20b-4a59-af06-d97bc00507a4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:40 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 Aug 26 03:09:40 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:40 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577" returned: 0 in 0.470s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:40 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577 Aug 26 03:09:40 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:41 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8c1f5f02-2030-4e5d-ab12-2e7b115e6577" returned: 0 in 0.416s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-quobyte-8c1f5f02-2030-4e5d-ab12-2e7b115e6577" released by "delete_volume" :: held 0.960s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Created reservations ['4fe884b2-0e58-429b-8ac1-9fdbaf60a115', 'e7fae70e-7126-485f-9ff9-5d961c741d46', '378186e1-7e83-4c92-b623-226af536f9bd', 'ef3964e8-1580-47f8-8fe2-590cfba987b3'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:41 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:41 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:41 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.379s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Deleted volume successfully. Aug 26 03:09:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bc83eecc-103a-4005-a54d-103bbd7551d6 tempest-CreateVolumesFromImageTest-674083925 None] Lock "cinder-8c1f5f02-2030-4e5d-ab12-2e7b115e6577-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Flow 'volume_create_manager' (a2b42b44-51c8-494e-af12-b7ae1ca497e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986dc537-d1b8-4380-9a4b-9c00f3f3bc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986dc537-d1b8-4380-9a4b-9c00f3f3bc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2015381873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f22a434-0dab-4206-aa77-5bc25e8c3822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='719aa7b29693415dae4fc7e9bf7ff2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:44Z,use_quota=True,user_id='cc7013c6ac494c6f8e9f6b408e46a29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(018f0785-f413-4daa-9162-b99746d38136),volume_type_id=018f0785-f413-4daa-9162-b99746d38136)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66391a2f-bdc3-4946-bc75-9d60c0b5f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66391a2f-bdc3-4946-bc75-9d60c0b5f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b929308-4a9e-48f6-9e03-618478791010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b929308-4a9e-48f6-9e03-618478791010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f22a434-0dab-4206-aa77-5bc25e8c3822', 'volume_name': 'volume-9f22a434-0dab-4206-aa77-5bc25e8c3822', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eccfb34-7685-42b6-80bf-a57f2a1dda81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eccfb34-7685-42b6-80bf-a57f2a1dda81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44deb926-c235-43d9-96c0-f5de8e4332d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:44 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume 9f22a434-0dab-4206-aa77-5bc25e8c3822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f22a434-0dab-4206-aa77-5bc25e8c3822', 'volume_size': 1} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2015381873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f22a434-0dab-4206-aa77-5bc25e8c3822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='719aa7b29693415dae4fc7e9bf7ff2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:44Z,use_quota=True,user_id='cc7013c6ac494c6f8e9f6b408e46a29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(018f0785-f413-4daa-9162-b99746d38136),volume_type_id=018f0785-f413-4daa-9162-b99746d38136)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Creating volume 9f22a434-0dab-4206-aa77-5bc25e8c3822 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:44 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:44 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 1073741824 Aug 26 03:09:44 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:44 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Flow 'volume_create_manager' (508b559e-4007-4f9c-976f-438245188968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf95f85-e233-4471-bc3a-ccbbfde95161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf95f85-e233-4471-bc3a-ccbbfde95161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1863456962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78034169-abb3-47d3-8ab9-757577ddd48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='719aa7b29693415dae4fc7e9bf7ff2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:45Z,use_quota=True,user_id='cc7013c6ac494c6f8e9f6b408e46a29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bbf296e-c0a1-4ab1-b754-ac552c3fff16),volume_type_id=5bbf296e-c0a1-4ab1-b754-ac552c3fff16)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272a541f-6374-4f0b-a6eb-a7ccd6ab0cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272a541f-6374-4f0b-a6eb-a7ccd6ab0cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c377be23-83eb-42ec-915c-a98939d60de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c377be23-83eb-42ec-915c-a98939d60de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78034169-abb3-47d3-8ab9-757577ddd48a', 'volume_name': 'volume-78034169-abb3-47d3-8ab9-757577ddd48a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7031a3-61a6-4b60-b9df-1b0743c3a520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7031a3-61a6-4b60-b9df-1b0743c3a520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847ff4b6-2ac4-4f99-a1f0-1cfac263a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume 78034169-abb3-47d3-8ab9-757577ddd48a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78034169-abb3-47d3-8ab9-757577ddd48a', 'volume_size': 1} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:45 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 1073741824" returned: 0 in 0.690s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:45 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 Aug 26 03:09:45 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:45 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822" returned: 0 in 0.377s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1863456962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78034169-abb3-47d3-8ab9-757577ddd48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='719aa7b29693415dae4fc7e9bf7ff2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:45Z,use_quota=True,user_id='cc7013c6ac494c6f8e9f6b408e46a29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bbf296e-c0a1-4ab1-b754-ac552c3fff16),volume_type_id=5bbf296e-c0a1-4ab1-b754-ac552c3fff16)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Creating volume 78034169-abb3-47d3-8ab9-757577ddd48a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:45 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:45 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a 1073741824 Aug 26 03:09:45 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44deb926-c235-43d9-96c0-f5de8e4332d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f22a434-0dab-4206-aa77-5bc25e8c3822', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0643ec70-7d36-4b3d-9b69-0d2fc7146c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 (9f22a434-0dab-4206-aa77-5bc25e8c3822): created successfully Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0643ec70-7d36-4b3d-9b69-0d2fc7146c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Flow 'volume_create_manager' (a2b42b44-51c8-494e-af12-b7ae1ca497e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:45 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2987a329-ca1b-4750-bb5c-8af6b13a78c6 tempest-TestInstancesWithCinderVolumes-1391919580 None] Created volume successfully. Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Flow 'volume_create_manager' (dc71e3cc-1e17-4d5a-8324-2b964de47ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13754179-5710-420a-8924-5c3c7dc624bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13754179-5710-420a-8924-5c3c7dc624bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2063618560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43048c2d-5e0f-40b9-8bdc-d006a477ec27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='719aa7b29693415dae4fc7e9bf7ff2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:46Z,use_quota=True,user_id='cc7013c6ac494c6f8e9f6b408e46a29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(254bff31-b791-4611-87b6-3a05a09fb83c),volume_type_id=254bff31-b791-4611-87b6-3a05a09fb83c)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ca6ee-ca96-47ab-a219-47739d457cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ca6ee-ca96-47ab-a219-47739d457cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d97864-1270-4971-8729-701e832d0fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:45 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:09:46 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a 1073741824" returned: 0 in 0.776s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:46 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a Aug 26 03:09:46 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d97864-1270-4971-8729-701e832d0fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43048c2d-5e0f-40b9-8bdc-d006a477ec27', 'volume_name': 'volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27', 'volume_size': 1, 'image_id': 'fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1966897381', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719aa7b29693415dae4fc7e9bf7ff2c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'created_at': datetime.datetime(2026, 8, 26, 1, 9, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1/file', 'properties': {}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8f4706-cd5e-40ff-907a-17bff44e4078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8f4706-cd5e-40ff-907a-17bff44e4078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b6619d-7747-406f-9b73-1be5f82b285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:46 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume 43048c2d-5e0f-40b9-8bdc-d006a477ec27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27', 'volume_size': 1, 'image_id': 'fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1966897381', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719aa7b29693415dae4fc7e9bf7ff2c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'created_at': datetime.datetime(2026, 8, 26, 1, 9, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1/file', 'properties': {}}, 'image_service': } Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Trying to clone 43048c2d-5e0f-40b9-8bdc-d006a477ec27 from image fd0ef1f8-dda8-4cc1-93ae-202598f385e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:09:46 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a" returned: 0 in 0.364s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847ff4b6-2ac4-4f99-a1f0-1cfac263a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78034169-abb3-47d3-8ab9-757577ddd48a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff16f8f3-5a00-4df4-93b3-0e890fa517ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:46 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume volume-78034169-abb3-47d3-8ab9-757577ddd48a (78034169-abb3-47d3-8ab9-757577ddd48a): created successfully Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff16f8f3-5a00-4df4-93b3-0e890fa517ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Flow 'volume_create_manager' (508b559e-4007-4f9c-976f-438245188968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6792176a-f8dd-4f0f-8af3-e78737991918 tempest-TestInstancesWithCinderVolumes-1391919580 None] Created volume successfully. Aug 26 03:09:50 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Flow 'volume_create_manager' (0dc9c396-bc8f-42fe-ae07-730b396bbb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d5491a-08c8-4086-9390-fbd2f3d5205e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d5491a-08c8-4086-9390-fbd2f3d5205e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f561ef-f3cb-4727-8565-7a4f89db9b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76728a8c32104d2aab46771763aff386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:51Z,use_quota=True,user_id='3c95b33254ef4743a370b8c0348aa56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f54fd8-db3e-4d78-821d-85ff81ee04f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f54fd8-db3e-4d78-821d-85ff81ee04f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359b63a4-0cbe-463a-b374-4fa7ebab16bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:50 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD, size 20.69 MB, duration 4.67 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:09:51 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Image download 20.69 MB at 4.43 MB/s Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e4cdf0-ed6c-4d18-a71f-bc39d0c00d74]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:51 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD Aug 26 03:09:51 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359b63a4-0cbe-463a-b374-4fa7ebab16bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49f561ef-f3cb-4727-8565-7a4f89db9b02', 'volume_name': 'volume-49f561ef-f3cb-4727-8565-7a4f89db9b02', 'volume_size': 1, 'image_id': '99c49a4b-c8e3-4c97-a7da-6581710296d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99c49a4b-c8e3-4c97-a7da-6581710296d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6777de31b29efbfcde4d2d6fcc8f93b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '76728a8c32104d2aab46771763aff386', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db6fcb581686ef8a6ff046b686fa87ae4a36b138239183f1829b30def16cb034a057fb7b9e647fa5f006feea4fb085853d63409131e5edc3501f1eee8f5ebb31', 'id': '99c49a4b-c8e3-4c97-a7da-6581710296d6', 'created_at': datetime.datetime(2026, 8, 26, 1, 9, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 9, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99c49a4b-c8e3-4c97-a7da-6581710296d6/file', 'properties': {}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0815a3-8c33-4536-97b2-f52266cdc490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0815a3-8c33-4536-97b2-f52266cdc490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97b690d-c29e-4266-a495-ea7c9e7b8f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:51 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Volume 49f561ef-f3cb-4727-8565-7a4f89db9b02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49f561ef-f3cb-4727-8565-7a4f89db9b02', 'volume_size': 1, 'image_id': '99c49a4b-c8e3-4c97-a7da-6581710296d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99c49a4b-c8e3-4c97-a7da-6581710296d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6777de31b29efbfcde4d2d6fcc8f93b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '76728a8c32104d2aab46771763aff386', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db6fcb581686ef8a6ff046b686fa87ae4a36b138239183f1829b30def16cb034a057fb7b9e647fa5f006feea4fb085853d63409131e5edc3501f1eee8f5ebb31', 'id': '99c49a4b-c8e3-4c97-a7da-6581710296d6', 'created_at': datetime.datetime(2026, 8, 26, 1, 9, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 9, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99c49a4b-c8e3-4c97-a7da-6581710296d6/file', 'properties': {}}, 'image_service': } Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Trying to clone 49f561ef-f3cb-4727-8565-7a4f89db9b02 from image 99c49a4b-c8e3-4c97-a7da-6581710296d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/99c49a4b-c8e3-4c97-a7da-6581710296d6', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:09:51 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Image download 0.00 MB at 0.00 MB/s Aug 26 03:09:51 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Temporary image fd0ef1f8-dda8-4cc1-93ae-202598f385e1 is fetched for user cc7013c6ac494c6f8e9f6b408e46a29b. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b033e5-03c2-4da9-a296-0e6d9f80fa97]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[be668d32-fecf-489e-b18c-ebfb88cbf78c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:51 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD Aug 26 03:09:51 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:52 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD Aug 26 03:09:52 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:52 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:52 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2063618560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43048c2d-5e0f-40b9-8bdc-d006a477ec27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='719aa7b29693415dae4fc7e9bf7ff2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:46Z,use_quota=True,user_id='cc7013c6ac494c6f8e9f6b408e46a29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(254bff31-b791-4611-87b6-3a05a09fb83c),volume_type_id=254bff31-b791-4611-87b6-3a05a09fb83c)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Creating volume 43048c2d-5e0f-40b9-8bdc-d006a477ec27 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:52 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:52 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 1073741824 Aug 26 03:09:52 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:52 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD Aug 26 03:09:52 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:52 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD" returned: 1 in 0.582s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Temporary image 99c49a4b-c8e3-4c97-a7da-6581710296d6 is fetched for user 3c95b33254ef4743a370b8c0348aa56d. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99aea87-66b4-45fc-9c9f-2615209274c2]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:53 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 1073741824" returned: 0 in 0.709s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:53 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD Aug 26 03:09:53 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:53 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 Aug 26 03:09:53 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:53 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:53 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27" returned: 0 in 0.414s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:53 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD Aug 26 03:09:53 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Attempting download of fd0ef1f8-dda8-4cc1-93ae-202598f385e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'metadata': {}}])) to volume 43048c2d-5e0f-40b9-8bdc-d006a477ec27. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fa2120-1cf5-4eba-954a-2c8f09fec669]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd0ef1f8-dda8-4cc1-93ae-202598f385e1__m529jm7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:53 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd0ef1f8-dda8-4cc1-93ae-202598f385e1__m529jm7 Aug 26 03:09:53 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:53 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD" returned: 1 in 0.470s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f561ef-f3cb-4727-8565-7a4f89db9b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76728a8c32104d2aab46771763aff386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:51Z,use_quota=True,user_id='3c95b33254ef4743a370b8c0348aa56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Creating volume 49f561ef-f3cb-4727-8565-7a4f89db9b02 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:53 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:09:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:53 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 1073741824 Aug 26 03:09:53 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:54 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd0ef1f8-dda8-4cc1-93ae-202598f385e1__m529jm7" returned: 0 in 0.432s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd0ef1f8-dda8-4cc1-93ae-202598f385e1__m529jm7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:54 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd0ef1f8-dda8-4cc1-93ae-202598f385e1__m529jm7 Aug 26 03:09:54 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:54 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 1073741824" returned: 0 in 0.570s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:54 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd0ef1f8-dda8-4cc1-93ae-202598f385e1__m529jm7" returned: 1 in 0.403s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd0ef1f8-dda8-4cc1-93ae-202598f385e1__m529jm7' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676434e-7b42-4589-8bdb-aa13d3711422]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:54 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 Aug 26 03:09:54 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:54 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD Aug 26 03:09:54 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:54 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02" returned: 0 in 0.347s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:54 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] fd0ef1f8-dda8-4cc1-93ae-202598f385e1 was qcow2, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:54 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 Aug 26 03:09:54 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:54 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Attempting download of 99c49a4b-c8e3-4c97-a7da-6581710296d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/99c49a4b-c8e3-4c97-a7da-6581710296d6', 'metadata': {}}])) to volume 49f561ef-f3cb-4727-8565-7a4f89db9b02. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:09:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e23c51e-498c-4875-b8c0-881dd9f0ca0c]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99c49a4b-c8e3-4c97-a7da-6581710296d6_kxhdxr9o {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:55 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99c49a4b-c8e3-4c97-a7da-6581710296d6_kxhdxr9o Aug 26 03:09:55 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:55 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99c49a4b-c8e3-4c97-a7da-6581710296d6_kxhdxr9o" returned: 0 in 0.465s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99c49a4b-c8e3-4c97-a7da-6581710296d6_kxhdxr9o {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:55 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99c49a4b-c8e3-4c97-a7da-6581710296d6_kxhdxr9o Aug 26 03:09:55 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:55 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99c49a4b-c8e3-4c97-a7da-6581710296d6_kxhdxr9o" returned: 1 in 0.448s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99c49a4b-c8e3-4c97-a7da-6581710296d6_kxhdxr9o' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:09:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b578bab-ab74-4467-b0fb-6015903399eb]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:56 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD Aug 26 03:09:56 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:56 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:56 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD Aug 26 03:09:56 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:56 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:09:56 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] 99c49a4b-c8e3-4c97-a7da-6581710296d6 was raw, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:09:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:56 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 Aug 26 03:09:56 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:57 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27" returned: 0 in 2.611s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:57 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fd0ef1f8-dda8-4cc1-93ae-202598f385e1_8k1rfa33devstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:09:57 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Converted 112.00 MB image at 42.87 MB/s Aug 26 03:09:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:57 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02" returned: 0 in 0.686s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:57 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99c49a4b-c8e3-4c97-a7da-6581710296d6_4e69wl9ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:09:57 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 03:09:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:57 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 1G Aug 26 03:09:57 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:57 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 1G Aug 26 03:09:57 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:58 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 1G" returned: 0 in 0.449s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Downloaded image fd0ef1f8-dda8-4cc1-93ae-202598f385e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'metadata': {}}])) to volume 43048c2d-5e0f-40b9-8bdc-d006a477ec27 successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Temporary image fd0ef1f8-dda8-4cc1-93ae-202598f385e1 for user cc7013c6ac494c6f8e9f6b408e46a29b is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Marking volume 43048c2d-5e0f-40b9-8bdc-d006a477ec27 as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:09:58 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 1G" returned: 0 in 0.456s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Downloaded image 99c49a4b-c8e3-4c97-a7da-6581710296d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/99c49a4b-c8e3-4c97-a7da-6581710296d6', 'metadata': {}}])) to volume 49f561ef-f3cb-4727-8565-7a4f89db9b02 successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Temporary image 99c49a4b-c8e3-4c97-a7da-6581710296d6 for user 3c95b33254ef4743a370b8c0348aa56d is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Marking volume 49f561ef-f3cb-4727-8565-7a4f89db9b02 as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Copying metadata from image fd0ef1f8-dda8-4cc1-93ae-202598f385e1 to 43048c2d-5e0f-40b9-8bdc-d006a477ec27. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Creating volume glance metadata for volume 43048c2d-5e0f-40b9-8bdc-d006a477ec27 backed by image fd0ef1f8-dda8-4cc1-93ae-202598f385e1 with: {'image_id': 'fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'image_name': 'tempest-scenario-img--1966897381', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Copying metadata from image 99c49a4b-c8e3-4c97-a7da-6581710296d6 to 49f561ef-f3cb-4727-8565-7a4f89db9b02. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Creating volume glance metadata for volume 49f561ef-f3cb-4727-8565-7a4f89db9b02 backed by image 99c49a4b-c8e3-4c97-a7da-6581710296d6 with: {'image_id': '99c49a4b-c8e3-4c97-a7da-6581710296d6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6777de31b29efbfcde4d2d6fcc8f93b4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b6619d-7747-406f-9b73-1be5f82b285c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27', 'volume_size': 1, 'image_id': 'fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1966897381', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719aa7b29693415dae4fc7e9bf7ff2c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fd0ef1f8-dda8-4cc1-93ae-202598f385e1', 'created_at': datetime.datetime(2026, 8, 26, 1, 9, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd0ef1f8-dda8-4cc1-93ae-202598f385e1/file', 'properties': {}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5819859-3219-46ba-b9ee-8790e1f00405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97b690d-c29e-4266-a495-ea7c9e7b8f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f561ef-f3cb-4727-8565-7a4f89db9b02', 'volume_size': 1, 'image_id': '99c49a4b-c8e3-4c97-a7da-6581710296d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99c49a4b-c8e3-4c97-a7da-6581710296d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6777de31b29efbfcde4d2d6fcc8f93b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '76728a8c32104d2aab46771763aff386', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db6fcb581686ef8a6ff046b686fa87ae4a36b138239183f1829b30def16cb034a057fb7b9e647fa5f006feea4fb085853d63409131e5edc3501f1eee8f5ebb31', 'id': '99c49a4b-c8e3-4c97-a7da-6581710296d6', 'created_at': datetime.datetime(2026, 8, 26, 1, 9, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 9, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99c49a4b-c8e3-4c97-a7da-6581710296d6/file', 'properties': {}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f54199-3036-4d29-8859-6640acad7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Volume volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 (43048c2d-5e0f-40b9-8bdc-d006a477ec27): created successfully Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5819859-3219-46ba-b9ee-8790e1f00405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Flow 'volume_create_manager' (dc71e3cc-1e17-4d5a-8324-2b964de47ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Volume volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 (49f561ef-f3cb-4727-8565-7a4f89db9b02): created successfully Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f54199-3036-4d29-8859-6640acad7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Flow 'volume_create_manager' (0dc9c396-bc8f-42fe-ae07-730b396bbb5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-02fedd46-bdf4-4125-8975-634afd01aeb2 tempest-TestInstancesWithCinderVolumes-1391919580 None] Created volume successfully. Aug 26 03:09:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1f9b871e-00ce-4c45-a5ef-247acc97ea55 tempest-VolumeImageDependencyTests-1543921473 None] Created volume successfully. Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Acquiring lock "cinder-49f561ef-f3cb-4727-8565-7a4f89db9b02-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Lock "cinder-49f561ef-f3cb-4727-8565-7a4f89db9b02-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Acquiring lock "cinder-quobyte-49f561ef-f3cb-4727-8565-7a4f89db9b02" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Lock "cinder-quobyte-49f561ef-f3cb-4727-8565-7a4f89db9b02" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b7c1d2-3bb3-4276-9730-f40a46ecfe1c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:58 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 Aug 26 03:09:58 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:59 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02" returned: 0 in 0.445s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:59 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02 Aug 26 03:09:59 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:59 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49f561ef-f3cb-4727-8565-7a4f89db9b02" returned: 0 in 0.442s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Lock "cinder-quobyte-49f561ef-f3cb-4727-8565-7a4f89db9b02" released by "delete_volume" :: held 0.950s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Created reservations ['21ca2e5e-aa98-4db7-81f0-c589109a7b6b', '5704ab93-9bc0-4d42-85e0-9229f8de0a2c', '2284c506-243a-4882-b17f-64599c1f2e1a', '1c6ae1e9-c32c-4e50-8f7d-b992e71b0e44'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:59 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:09:59 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:00 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.377s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:10:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Deleted volume successfully. Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bb5a95b6-a2bd-4405-9daf-5436745aee1c tempest-VolumeImageDependencyTests-1543921473 None] Lock "cinder-49f561ef-f3cb-4727-8565-7a4f89db9b02-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Flow 'volume_create_manager' (523989f6-bd5e-4523-9548-1640e910a0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692b5a90-c287-49b5-b03d-c32695535088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692b5a90-c287-49b5-b03d-c32695535088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1260720631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a910c15a-8b7a-49a0-888c-6af0f7341b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c8ab5289d945768c4fb664c84907f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:00Z,use_quota=True,user_id='48f1ad9688794637a9921d54a3570103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eb5508-36d3-42eb-9950-f24fde5027ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eb5508-36d3-42eb-9950-f24fde5027ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816a8688-1dd8-438a-b197-10270fc310a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816a8688-1dd8-438a-b197-10270fc310a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a910c15a-8b7a-49a0-888c-6af0f7341b4f', 'volume_name': 'volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c4ce09-4ade-4e97-a033-20ac1faf55d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c4ce09-4ade-4e97-a033-20ac1faf55d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502e47a1-5e8e-42ea-aff0-4639df52f082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:00 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Volume a910c15a-8b7a-49a0-888c-6af0f7341b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f', 'volume_size': 1} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1260720631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a910c15a-8b7a-49a0-888c-6af0f7341b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c8ab5289d945768c4fb664c84907f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:00Z,use_quota=True,user_id='48f1ad9688794637a9921d54a3570103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Creating volume a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:00 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:10:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:00 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f 1073741824 Aug 26 03:10:00 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:01 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f 1073741824" returned: 0 in 0.684s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:01 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f Aug 26 03:10:01 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:01 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f" returned: 0 in 0.489s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502e47a1-5e8e-42ea-aff0-4639df52f082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b41bc3e-558a-4ce3-8773-6609dade031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:01 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Volume volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f (a910c15a-8b7a-49a0-888c-6af0f7341b4f): created successfully Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b41bc3e-558a-4ce3-8773-6609dade031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:01 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Flow 'volume_create_manager' (523989f6-bd5e-4523-9548-1640e910a0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:01 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-67359f9e-4258-4539-8a33-9485acef209e tempest-TestStampPattern-430277665 None] Created volume successfully. Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:02 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:10:02 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:02 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.426s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:10:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:10:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f087a2a8-d9dd-4284-9ecd-2c16a0cb7793 req-8895b11d-cb33-4478-8df2-ceacc037b184 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f087a2a8-d9dd-4284-9ecd-2c16a0cb7793 req-8895b11d-cb33-4478-8df2-ceacc037b184 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f087a2a8-d9dd-4284-9ecd-2c16a0cb7793 req-8895b11d-cb33-4478-8df2-ceacc037b184 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-f087a2a8-d9dd-4284-9ecd-2c16a0cb7793 req-8895b11d-cb33-4478-8df2-ceacc037b184 tempest-TestInstancesWithCinderVolumes-1391919580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e39ae468-5592-4ed8-a765-96626ba8a661', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:10:04 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-f087a2a8-d9dd-4284-9ecd-2c16a0cb7793 req-8895b11d-cb33-4478-8df2-ceacc037b184 tempest-TestInstancesWithCinderVolumes-1391919580 None] attachment_update completed successfully. Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Flow 'volume_create_manager' (d6ccc458-690f-4e18-a5bb-edff647fc5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6322f568-5147-476a-bef2-bad1a9917ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6322f568-5147-476a-bef2-bad1a9917ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323808942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef8f1d8-93a0-461b-9c11-438391412a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf8f91aa31642c7bbe21a6470e4fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:08Z,use_quota=True,user_id='fb5e6e08f0a84ccfb432fdd7bdc0ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660a2b50-4e33-4f67-b222-46187986f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660a2b50-4e33-4f67-b222-46187986f366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a6b872-fc21-488f-b58f-f0b8fe74edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a6b872-fc21-488f-b58f-f0b8fe74edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef8f1d8-93a0-461b-9c11-438391412a16', 'volume_name': 'volume-bef8f1d8-93a0-461b-9c11-438391412a16', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260fcef9-0698-4cda-b03c-68619ce0465b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260fcef9-0698-4cda-b03c-68619ce0465b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88306f2-9c70-4193-b078-eae08c5d0fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:07 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Volume bef8f1d8-93a0-461b-9c11-438391412a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef8f1d8-93a0-461b-9c11-438391412a16', 'volume_size': 1} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323808942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef8f1d8-93a0-461b-9c11-438391412a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf8f91aa31642c7bbe21a6470e4fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:08Z,use_quota=True,user_id='fb5e6e08f0a84ccfb432fdd7bdc0ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Creating volume bef8f1d8-93a0-461b-9c11-438391412a16 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:07 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:10:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:07 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 1073741824 Aug 26 03:10:07 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:08 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 1073741824" returned: 0 in 1.014s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:08 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 Aug 26 03:10:08 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:09 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16" returned: 0 in 0.385s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88306f2-9c70-4193-b078-eae08c5d0fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef8f1d8-93a0-461b-9c11-438391412a16', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0381121d-0a80-4725-9e87-112d1e2669a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Volume volume-bef8f1d8-93a0-461b-9c11-438391412a16 (bef8f1d8-93a0-461b-9c11-438391412a16): created successfully Aug 26 03:10:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0381121d-0a80-4725-9e87-112d1e2669a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Flow 'volume_create_manager' (d6ccc458-690f-4e18-a5bb-edff647fc5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-63f5f5bd-7760-4014-a583-32ffb3d2a2fa tempest-ProjectReaderTests-521843469 None] Created volume successfully. Aug 26 03:10:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Acquiring lock "cinder-bef8f1d8-93a0-461b-9c11-438391412a16-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Lock "cinder-bef8f1d8-93a0-461b-9c11-438391412a16-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Acquiring lock "cinder-quobyte-bef8f1d8-93a0-461b-9c11-438391412a16" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Lock "cinder-quobyte-bef8f1d8-93a0-461b-9c11-438391412a16" acquired by "delete_volume" :: waited 0.046s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab8fea-d107-43b9-8ce7-c00f4af6267b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:10 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 Aug 26 03:10:10 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:10 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16" returned: 0 in 0.518s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:10 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16 Aug 26 03:10:10 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:11 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-bef8f1d8-93a0-461b-9c11-438391412a16" returned: 0 in 0.289s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Lock "cinder-quobyte-bef8f1d8-93a0-461b-9c11-438391412a16" released by "delete_volume" :: held 0.893s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:INSERT=28,cinder:UPDATE=99,cinder:SELECT=63,cinder:DELETE=8 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Created reservations ['93aa61ab-8017-49c8-893b-04efb862d013', '73a83119-ce5a-40bb-8845-dced6d0245b0', '53190430-27ca-4b8a-832e-c1516877d07e', '600c4edc-f7d0-44a2-925b-108fe5a29fae'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:11 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:10:11 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:11 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.302s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:10:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Deleted volume successfully. Aug 26 03:10:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e95320c3-8563-4d9a-9ab2-c7522d1032ee tempest-ProjectReaderTests-521843469 None] Lock "cinder-bef8f1d8-93a0-461b-9c11-438391412a16-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Flow 'volume_create_manager' (2e88a4ea-8755-4920-9cd6-fd6600ed8da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2fed8f-80da-4bd3-80f5-649eb2dfd0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2fed8f-80da-4bd3-80f5-649eb2dfd0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516896778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaacfb4-3201-4b24-a8ec-005c6a4d0183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf8f91aa31642c7bbe21a6470e4fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:14Z,use_quota=True,user_id='fb5e6e08f0a84ccfb432fdd7bdc0ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c37f01-2c86-481a-873e-001de5725673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c37f01-2c86-481a-873e-001de5725673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd48674e-b970-431b-b583-a893c17ecba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd48674e-b970-431b-b583-a893c17ecba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faaacfb4-3201-4b24-a8ec-005c6a4d0183', 'volume_name': 'volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85625b5-6c58-4740-8c13-3ed0a52cc264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85625b5-6c58-4740-8c13-3ed0a52cc264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429ac916-e646-44fd-89ef-ef31ae564da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:13 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Volume faaacfb4-3201-4b24-a8ec-005c6a4d0183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183', 'volume_size': 1} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516896778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaacfb4-3201-4b24-a8ec-005c6a4d0183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf8f91aa31642c7bbe21a6470e4fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:14Z,use_quota=True,user_id='fb5e6e08f0a84ccfb432fdd7bdc0ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Creating volume faaacfb4-3201-4b24-a8ec-005c6a4d0183 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:13 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:10:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:14 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 1073741824 Aug 26 03:10:14 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:14 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 1073741824" returned: 0 in 0.746s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:14 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 Aug 26 03:10:14 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:15 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183" returned: 0 in 0.409s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429ac916-e646-44fd-89ef-ef31ae564da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ff2a07-59c2-4b50-947e-4377f4a499dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Volume volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 (faaacfb4-3201-4b24-a8ec-005c6a4d0183): created successfully Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ff2a07-59c2-4b50-947e-4377f4a499dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Flow 'volume_create_manager' (2e88a4ea-8755-4920-9cd6-fd6600ed8da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-dfcd937e-27e3-45e6-b297-37d6bcde2a4f tempest-ProjectReaderTests-521843469 None] Created volume successfully. Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Acquiring lock "cinder-faaacfb4-3201-4b24-a8ec-005c6a4d0183-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Lock "cinder-faaacfb4-3201-4b24-a8ec-005c6a4d0183-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Acquiring lock "cinder-quobyte-faaacfb4-3201-4b24-a8ec-005c6a4d0183" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Lock "cinder-quobyte-faaacfb4-3201-4b24-a8ec-005c6a4d0183" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[951c3266-5a0a-4952-9ad3-3de7dada592e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:16 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 Aug 26 03:10:16 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:17 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183" returned: 0 in 0.904s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:17 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183 Aug 26 03:10:17 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:17 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-faaacfb4-3201-4b24-a8ec-005c6a4d0183" returned: 0 in 0.706s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Lock "cinder-quobyte-faaacfb4-3201-4b24-a8ec-005c6a4d0183" released by "delete_volume" :: held 1.729s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:17 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Created reservations ['bfda0804-ca83-4a13-8eb2-89ab8f3017b3', '2ad75d60-9dbe-49b1-b9f6-c710ca737302', '872712fa-00ef-4698-a3a5-2fe009e4a138', '766982cb-05d3-4406-9b01-dfad12d95fd0'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:10:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:18 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:10:18 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:18 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.840s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:18 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:10:18 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Deleted volume successfully. Aug 26 03:10:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3d4c992a-b9e1-4f74-aa77-28b078d16549 tempest-ProjectReaderTests-521843469 None] Lock "cinder-faaacfb4-3201-4b24-a8ec-005c6a4d0183-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:19 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Flow 'volume_create_manager' (394d8792-230e-4ff0-9d78-ff70d9979086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c8b6a1-515a-4ec9-9e44-9a6bb5443fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c8b6a1-515a-4ec9-9e44-9a6bb5443fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695490364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2a200d-e810-45f0-ae8f-3638627dfa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf8f91aa31642c7bbe21a6470e4fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:20Z,use_quota=True,user_id='fb5e6e08f0a84ccfb432fdd7bdc0ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afbb49a-fbd6-4d31-86a8-47611f25c888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afbb49a-fbd6-4d31-86a8-47611f25c888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f401f08-b09c-4dcf-bed9-a04c65eea5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f401f08-b09c-4dcf-bed9-a04c65eea5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2a200d-e810-45f0-ae8f-3638627dfa30', 'volume_name': 'volume-0d2a200d-e810-45f0-ae8f-3638627dfa30', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95facc-f125-4fb2-9ddd-321b4fc4213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95facc-f125-4fb2-9ddd-321b4fc4213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf74228-01a8-4757-9031-16cf00409c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Volume 0d2a200d-e810-45f0-ae8f-3638627dfa30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2a200d-e810-45f0-ae8f-3638627dfa30', 'volume_size': 1} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695490364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2a200d-e810-45f0-ae8f-3638627dfa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf8f91aa31642c7bbe21a6470e4fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:20Z,use_quota=True,user_id='fb5e6e08f0a84ccfb432fdd7bdc0ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Creating volume 0d2a200d-e810-45f0-ae8f-3638627dfa30 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:20 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:10:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:20 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 1073741824 Aug 26 03:10:20 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:21 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 1073741824" returned: 0 in 1.172s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:21 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 Aug 26 03:10:21 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:22 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30" returned: 0 in 0.822s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf74228-01a8-4757-9031-16cf00409c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2a200d-e810-45f0-ae8f-3638627dfa30', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174dc629-8f2e-455e-942a-91747a4a3bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:22 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Volume volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 (0d2a200d-e810-45f0-ae8f-3638627dfa30): created successfully Aug 26 03:10:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174dc629-8f2e-455e-942a-91747a4a3bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Flow 'volume_create_manager' (394d8792-230e-4ff0-9d78-ff70d9979086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:22 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0ff0136d-a089-44f6-b64d-5626a7f58943 tempest-ProjectReaderTests-521843469 None] Created volume successfully. Aug 26 03:10:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Acquiring lock "cinder-0d2a200d-e810-45f0-ae8f-3638627dfa30-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Lock "cinder-0d2a200d-e810-45f0-ae8f-3638627dfa30-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Acquiring lock "cinder-quobyte-0d2a200d-e810-45f0-ae8f-3638627dfa30" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Lock "cinder-quobyte-0d2a200d-e810-45f0-ae8f-3638627dfa30" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadfa0f8-98c7-4bfc-a078-796d5c708d9b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:23 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 Aug 26 03:10:23 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:24 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30" returned: 0 in 0.655s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:24 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30 Aug 26 03:10:24 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:24 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0d2a200d-e810-45f0-ae8f-3638627dfa30" returned: 0 in 0.409s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Lock "cinder-quobyte-0d2a200d-e810-45f0-ae8f-3638627dfa30" released by "delete_volume" :: held 1.143s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Created reservations ['26d950b5-4ea6-459e-82d3-647cfecbf63a', '16bf45c7-8912-4a40-a831-db17688d0261', '636b0b78-7f51-492f-88f5-fda7066b6cae', '43faf912-3834-43c1-ad37-d612051ea1d4'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:25 devstack sudo[109566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:10:25 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:25 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.436s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:25 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:10:25 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Deleted volume successfully. Aug 26 03:10:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-366d0b65-f94d-4f56-8e4a-7ddfdd95d1f5 tempest-ProjectReaderTests-521843469 None] Lock "cinder-0d2a200d-e810-45f0-ae8f-3638627dfa30-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Flow 'volume_create_manager' (6b080be4-ce92-4318-8e56-a81b78726c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6158e30-6c40-49e3-b3a4-2f0fc47dfb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6158e30-6c40-49e3-b3a4-2f0fc47dfb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1281255744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8eebe3-a702-4108-b274-a93468d6235a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf8f91aa31642c7bbe21a6470e4fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:27Z,use_quota=True,user_id='fb5e6e08f0a84ccfb432fdd7bdc0ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71132576-52ac-401d-8dce-58b2f0e9e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71132576-52ac-401d-8dce-58b2f0e9e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ffd1d4-6d38-4bbe-922d-8c494ac92fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ffd1d4-6d38-4bbe-922d-8c494ac92fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8eebe3-a702-4108-b274-a93468d6235a', 'volume_name': 'volume-0e8eebe3-a702-4108-b274-a93468d6235a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ff3579-49cc-4cb0-8e6e-202fa12fd589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ff3579-49cc-4cb0-8e6e-202fa12fd589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706f3b45-d9da-46ea-ad9d-13ba2badb470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:26 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Volume 0e8eebe3-a702-4108-b274-a93468d6235a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8eebe3-a702-4108-b274-a93468d6235a', 'volume_size': 1} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1281255744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8eebe3-a702-4108-b274-a93468d6235a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf8f91aa31642c7bbe21a6470e4fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:27Z,use_quota=True,user_id='fb5e6e08f0a84ccfb432fdd7bdc0ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Creating volume 0e8eebe3-a702-4108-b274-a93468d6235a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:26 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:10:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:26 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a 1073741824 Aug 26 03:10:26 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:27 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a 1073741824" returned: 0 in 1.065s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:28 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a Aug 26 03:10:28 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:28 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a" returned: 0 in 0.425s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706f3b45-d9da-46ea-ad9d-13ba2badb470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8eebe3-a702-4108-b274-a93468d6235a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2121509-0886-4d87-82e4-9d7c6b0311f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Volume volume-0e8eebe3-a702-4108-b274-a93468d6235a (0e8eebe3-a702-4108-b274-a93468d6235a): created successfully Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2121509-0886-4d87-82e4-9d7c6b0311f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Flow 'volume_create_manager' (6b080be4-ce92-4318-8e56-a81b78726c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3e2766a1-a812-4efc-82ea-e0c32ac5e287 tempest-ProjectReaderTests-521843469 None] Created volume successfully. Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Acquiring lock "cinder-0e8eebe3-a702-4108-b274-a93468d6235a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Lock "cinder-0e8eebe3-a702-4108-b274-a93468d6235a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Acquiring lock "cinder-quobyte-0e8eebe3-a702-4108-b274-a93468d6235a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Lock "cinder-quobyte-0e8eebe3-a702-4108-b274-a93468d6235a" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8bb5da-975e-4281-bc91-16d961676137]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:29 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a Aug 26 03:10:29 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:29 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a" returned: 0 in 0.395s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:29 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a Aug 26 03:10:29 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:29 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e8eebe3-a702-4108-b274-a93468d6235a" returned: 0 in 0.268s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Lock "cinder-quobyte-0e8eebe3-a702-4108-b274-a93468d6235a" released by "delete_volume" :: held 0.720s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Created reservations ['ec7e0fa6-083c-41eb-9a8f-00731cab59b0', '4ef39570-90ca-461a-886c-80c42d087d50', 'af5befed-46dd-440a-b3b4-eca1e587c3cd', '224dfcfc-db71-46a2-a3c6-d483fc99772b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:29 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:10:29 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:30 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.302s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:30 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:10:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Deleted volume successfully. Aug 26 03:10:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3b096761-a96d-4642-a31a-970b23ada13a tempest-ProjectReaderTests-521843469 None] Lock "cinder-0e8eebe3-a702-4108-b274-a93468d6235a-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:39 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=109,cinder:SELECT=95,cinder:INSERT=33,cinder:DELETE=10 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:10:40 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:INSERT=10,cinder:UPDATE=44,cinder:SELECT=23,cinder:DELETE=5 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:10:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1cdc8523-ba8b-49f0-8d21-97c2c2282c63 req-c47a0208-c26b-4ff6-807f-2ee94f9cf0ac tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1cdc8523-ba8b-49f0-8d21-97c2c2282c63 req-c47a0208-c26b-4ff6-807f-2ee94f9cf0ac tempest-TestStampPattern-430277665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1cdc8523-ba8b-49f0-8d21-97c2c2282c63 req-c47a0208-c26b-4ff6-807f-2ee94f9cf0ac tempest-TestStampPattern-430277665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-1cdc8523-ba8b-49f0-8d21-97c2c2282c63 req-c47a0208-c26b-4ff6-807f-2ee94f9cf0ac tempest-TestStampPattern-430277665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83300549-b807-4c38-9aa6-f43eb440e366', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:10:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-1cdc8523-ba8b-49f0-8d21-97c2c2282c63 req-c47a0208-c26b-4ff6-807f-2ee94f9cf0ac tempest-TestStampPattern-430277665 None] attachment_update completed successfully. Aug 26 03:10:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-c8d5c9ff-2162-4081-bea6-2b9e70b29bc9 req-631950f7-28f2-47f2-8fa8-ccc5b2d9e3d6 tempest-TestStampPattern-430277665 None] Terminate volume connection completed successfully. Aug 26 03:10:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-c8d5c9ff-2162-4081-bea6-2b9e70b29bc9 req-631950f7-28f2-47f2-8fa8-ccc5b2d9e3d6 tempest-TestStampPattern-430277665 None] Deleting attachment 83300549-b807-4c38-9aa6-f43eb440e366. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:10:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Creating offline snapshot 180783d0-ab9f-4a87-b2c3-d2ad1ad31439 of volume a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:10:47 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0a2127-901d-4a26-b842-933b42ee99f7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:47 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f Aug 26 03:10:47 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:48 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f" returned: 0 in 0.436s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:48 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 1G Aug 26 03:10:48 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:48 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 1G" returned: 0 in 0.516s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:48 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 Aug 26 03:10:48 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-dd3022f5-113e-4663-a441-9466d76c41aa req-a2930247-427f-4fbc-ac01-a0314d81de4b tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:49 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439" returned: 0 in 0.364s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:49 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 is being set with open permissions: ugo+rw Aug 26 03:10:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:49 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 Aug 26 03:10:49 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:49 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439" returned: 0 in 0.293s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:49 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.info Aug 26 03:10:49 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:49 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.info" returned: 0 in 0.281s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:49 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.info is being set with open permissions: ugo+rw Aug 26 03:10:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:49 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.info Aug 26 03:10:49 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:49 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.info" returned: 0 in 0.288s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-dd3022f5-113e-4663-a441-9466d76c41aa req-a2930247-427f-4fbc-ac01-a0314d81de4b tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.211s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-dd3022f5-113e-4663-a441-9466d76c41aa req-a2930247-427f-4fbc-ac01-a0314d81de4b tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-924541c3-63a6-4f43-9b20-c1a2d85fd318 tempest-TestStampPattern-430277665 None] Create snapshot completed successfully Aug 26 03:10:50 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-dd3022f5-113e-4663-a441-9466d76c41aa req-a2930247-427f-4fbc-ac01-a0314d81de4b tempest-TestInstancesWithCinderVolumes-1391919580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-9f22a434-0dab-4206-aa77-5bc25e8c3822', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fe47c72-4b0d-4a60-a243-d128249a19f6', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:10:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-dd3022f5-113e-4663-a441-9466d76c41aa req-a2930247-427f-4fbc-ac01-a0314d81de4b tempest-TestInstancesWithCinderVolumes-1391919580 None] attachment_update completed successfully. Aug 26 03:10:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d9367f33-2a09-4fe1-87ba-756f29e17bdf req-49f1303b-dd0b-43d8-990a-df541575a1e5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d9367f33-2a09-4fe1-87ba-756f29e17bdf req-49f1303b-dd0b-43d8-990a-df541575a1e5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d9367f33-2a09-4fe1-87ba-756f29e17bdf req-49f1303b-dd0b-43d8-990a-df541575a1e5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-d9367f33-2a09-4fe1-87ba-756f29e17bdf req-49f1303b-dd0b-43d8-990a-df541575a1e5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-78034169-abb3-47d3-8ab9-757577ddd48a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f4b3341-93c1-470c-9eb8-0b01938b8d25', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:10:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-d9367f33-2a09-4fe1-87ba-756f29e17bdf req-49f1303b-dd0b-43d8-990a-df541575a1e5 tempest-TestInstancesWithCinderVolumes-1391919580 None] attachment_update completed successfully. Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Flow 'volume_create_manager' (8ffeaacb-4659-4eef-9d18-b863e14b6ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2010a8-778a-4841-837e-6880f284b1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2010a8-778a-4841-837e-6880f284b1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-344117285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a16af70-0109-40c2-85a1-a12e232b97fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c8ab5289d945768c4fb664c84907f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=180783d0-ab9f-4a87-b2c3-d2ad1ad31439,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:59Z,use_quota=True,user_id='48f1ad9688794637a9921d54a3570103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38e1652-e47b-4dad-8cc8-39c97f7dc6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38e1652-e47b-4dad-8cc8-39c97f7dc6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc88d74a-a98e-4bd6-8c57-22a2506e1f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc88d74a-a98e-4bd6-8c57-22a2506e1f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a16af70-0109-40c2-85a1-a12e232b97fb', 'volume_name': 'volume-1a16af70-0109-40c2-85a1-a12e232b97fb', 'volume_size': 1, 'snapshot_id': '180783d0-ab9f-4a87-b2c3-d2ad1ad31439'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e999313-4628-41d9-a1d6-91c77ef58e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e999313-4628-41d9-a1d6-91c77ef58e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf5f40f-4d42-4840-b5f7-3957de6ab385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:59 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Volume 1a16af70-0109-40c2-85a1-a12e232b97fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a16af70-0109-40c2-85a1-a12e232b97fb', 'volume_size': 1, 'snapshot_id': '180783d0-ab9f-4a87-b2c3-d2ad1ad31439'} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-quobyte-180783d0-ab9f-4a87-b2c3-d2ad1ad31439-1a16af70-0109-40c2-85a1-a12e232b97fb" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-180783d0-ab9f-4a87-b2c3-d2ad1ad31439-1a16af70-0109-40c2-85a1-a12e232b97fb" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Creating volume 1a16af70-0109-40c2-85a1-a12e232b97fb from snapshot 180783d0-ab9f-4a87-b2c3-d2ad1ad31439 {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-quobyte-1a16af70-0109-40c2-85a1-a12e232b97fb" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-1a16af70-0109-40c2-85a1-a12e232b97fb" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] snapshot: 180783d0-ab9f-4a87-b2c3-d2ad1ad31439, volume: 1a16af70-0109-40c2-85a1-a12e232b97fb, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aefb0a4-5823-4c5d-bbf7-4c9b85204e8c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:59 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 Aug 26 03:10:59 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:59 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439" returned: 0 in 0.526s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9931de-e3e3-47fe-abd1-08ce8aa913c7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-8f95ccf4-396f-49e2-96dc-3fd7c407619f req-7166af0a-7b5a-4ace-81aa-843ce9340ada tempest-TestInstancesWithCinderVolumes-1391919580 None] Terminate volume connection completed successfully. Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-8f95ccf4-396f-49e2-96dc-3fd7c407619f req-7166af0a-7b5a-4ace-81aa-843ce9340ada tempest-TestInstancesWithCinderVolumes-1391919580 None] Deleting attachment 8fe47c72-4b0d-4a60-a243-d128249a19f6. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:11:00 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f Aug 26 03:11:00 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:00 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f" returned: 0 in 0.558s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:00 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb Aug 26 03:11:00 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "cinder-9f22a434-0dab-4206-aa77-5bc25e8c3822-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-9f22a434-0dab-4206-aa77-5bc25e8c3822-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "cinder-quobyte-9f22a434-0dab-4206-aa77-5bc25e8c3822" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-quobyte-9f22a434-0dab-4206-aa77-5bc25e8c3822" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dfac91-9115-4385-ab2b-df6bbf1f8d61]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:00 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 Aug 26 03:11:00 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:01 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822" returned: 0 in 0.596s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:01 devstack sudo[109931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822 Aug 26 03:11:01 devstack sudo[109931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:02 devstack sudo[109937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:11:02 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:02 devstack sudo[109931]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9f22a434-0dab-4206-aa77-5bc25e8c3822" returned: 0 in 1.022s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-quobyte-9f22a434-0dab-4206-aa77-5bc25e8c3822" released by "delete_volume" :: held 1.726s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:02 devstack cinder-volume[93797]: WARNING cinder.quota [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1976719316-1145399386 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1976719316-1145399386, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:11:02 devstack cinder-volume[93797]: WARNING cinder.quota [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1976719316-1145399386 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1976719316-1145399386, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Created reservations ['baeb419a-3fd4-4fbb-8795-94b10fc3049e', 'd4ec39ad-e57c-4003-9bf3-05dd8d1d24d4', 'fb8fe370-3d09-4be7-ac9b-2aae3c081796', '62ab6e45-88a4-4050-a11a-21f1f469bd9b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:03 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:11:03 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:03 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 1.662s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:03 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:03 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:11:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:11:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:11:04 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 1.438s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:04 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:04 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Deleted volume successfully. Aug 26 03:11:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-46e1084f-0746-4925-83f9-7e997d81717b tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-9f22a434-0dab-4206-aa77-5bc25e8c3822-delete_volume" released by "delete_volume" :: held 3.910s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:08 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb" returned: 0 in 7.638s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:11:08 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Converted 1024.00 MB image at 133.95 MB/s Aug 26 03:11:08 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb is being set with open permissions: ugo+rw Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:08 devstack sudo[109970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb Aug 26 03:11:08 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-06137b0c-5045-400c-902e-8a96b7430989 req-50ba766a-efec-494e-8de5-ac8098c017c8 tempest-TestInstancesWithCinderVolumes-1391919580 None] Terminate volume connection completed successfully. Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-06137b0c-5045-400c-902e-8a96b7430989 req-50ba766a-efec-494e-8de5-ac8098c017c8 tempest-TestInstancesWithCinderVolumes-1391919580 None] Deleting attachment 2f4b3341-93c1-470c-9eb8-0b01938b8d25. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:11:08 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb" returned: 0 in 0.438s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-1a16af70-0109-40c2-85a1-a12e232b97fb" released by "_copy_volume_from_snapshot" :: held 9.306s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-180783d0-ab9f-4a87-b2c3-d2ad1ad31439-1a16af70-0109-40c2-85a1-a12e232b97fb" released by "_create_volume_from_snapshot" :: held 9.418s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.443s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf5f40f-4d42-4840-b5f7-3957de6ab385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a16af70-0109-40c2-85a1-a12e232b97fb', 'volume_size': 1, 'snapshot_id': '180783d0-ab9f-4a87-b2c3-d2ad1ad31439'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4615d135-0a07-464c-8157-83653ff4542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:11:08 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Volume volume-1a16af70-0109-40c2-85a1-a12e232b97fb (1a16af70-0109-40c2-85a1-a12e232b97fb): created successfully Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4615d135-0a07-464c-8157-83653ff4542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:11:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Flow 'volume_create_manager' (8ffeaacb-4659-4eef-9d18-b863e14b6ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:11:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3df2cf31-3034-458a-81ee-ffb19534ace6 tempest-TestStampPattern-430277665 None] Created volume successfully. Aug 26 03:11:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "cinder-78034169-abb3-47d3-8ab9-757577ddd48a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-78034169-abb3-47d3-8ab9-757577ddd48a-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "cinder-quobyte-78034169-abb3-47d3-8ab9-757577ddd48a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-quobyte-78034169-abb3-47d3-8ab9-757577ddd48a" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f4502f-f6c7-4959-a93f-d540c03c8ee6]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:10 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a Aug 26 03:11:10 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:10 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a" returned: 0 in 0.586s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:10 devstack sudo[110037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a Aug 26 03:11:10 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:11 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-78034169-abb3-47d3-8ab9-757577ddd48a" returned: 0 in 0.414s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-quobyte-78034169-abb3-47d3-8ab9-757577ddd48a" released by "delete_volume" :: held 1.162s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:11 devstack cinder-volume[93797]: WARNING cinder.quota [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2073272452-672980348 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2073272452-672980348, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:11:11 devstack cinder-volume[93797]: WARNING cinder.quota [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2073272452-672980348 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2073272452-672980348, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Created reservations ['cb1a850f-1b71-4668-82ec-c88472ef453e', '4bb4a4e3-fc0b-443f-a026-7da92eab2ccc', 'e95408cd-3598-441d-8b7c-d4bd02388f5e', '557924ce-b0f3-4517-856e-c7d3299febe9'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:11 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:11:11 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:11 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.299s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Deleted volume successfully. Aug 26 03:11:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d277e72e-1056-406a-94d1-22ef273795b5 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-78034169-abb3-47d3-8ab9-757577ddd48a-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:16 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-8165d78a-b2ac-4658-bbb9-72dc4d4b47f7 req-8a0a1be9-622d-4c60-b027-1c606b3c02cd tempest-TestInstancesWithCinderVolumes-1391919580 None] Terminate volume connection completed successfully. Aug 26 03:11:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-8165d78a-b2ac-4658-bbb9-72dc4d4b47f7 req-8a0a1be9-622d-4c60-b027-1c606b3c02cd tempest-TestInstancesWithCinderVolumes-1391919580 None] Deleting attachment e39ae468-5592-4ed8-a765-96626ba8a661. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:11:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "cinder-43048c2d-5e0f-40b9-8bdc-d006a477ec27-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-43048c2d-5e0f-40b9-8bdc-d006a477ec27-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "cinder-quobyte-43048c2d-5e0f-40b9-8bdc-d006a477ec27" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-quobyte-43048c2d-5e0f-40b9-8bdc-d006a477ec27" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8e3b8d-063c-477d-b6d3-9e40b9cb0aba]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:18 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 Aug 26 03:11:18 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:18 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27" returned: 0 in 0.497s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:18 devstack sudo[110105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27 Aug 26 03:11:18 devstack sudo[110105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:18 devstack sudo[110105]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-43048c2d-5e0f-40b9-8bdc-d006a477ec27" returned: 0 in 0.475s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-quobyte-43048c2d-5e0f-40b9-8bdc-d006a477ec27" released by "delete_volume" :: held 1.052s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:18 devstack cinder-volume[93797]: WARNING cinder.quota [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-68951682-1876644092 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-68951682-1876644092, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:11:18 devstack cinder-volume[93797]: WARNING cinder.quota [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-68951682-1876644092 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-68951682-1876644092, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:11:18 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Created reservations ['6b78f854-5fe5-4c36-8639-cca6bd997d8b', 'f3826e44-9252-4ad2-b27d-73d5041b72fa', 'b1800caf-001d-419f-9ee1-09a1bd9748f3', '4bf6064d-0598-4218-9338-c887de849ec0'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:19 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:11:19 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:19 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.519s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Deleted volume successfully. Aug 26 03:11:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f7b0700e-eb83-4505-9801-f25060ba82f0 tempest-TestInstancesWithCinderVolumes-1391919580 None] Lock "cinder-43048c2d-5e0f-40b9-8bdc-d006a477ec27-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:30 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=40,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=3 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:11:30 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=52,cinder:UPDATE=36,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:11:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f20e60d7-db53-485d-a88e-c9ba4ace7703 req-2454d614-bf06-44c9-9772-c45a7b6dd5bd tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f20e60d7-db53-485d-a88e-c9ba4ace7703 req-2454d614-bf06-44c9-9772-c45a7b6dd5bd tempest-TestStampPattern-430277665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f20e60d7-db53-485d-a88e-c9ba4ace7703 req-2454d614-bf06-44c9-9772-c45a7b6dd5bd tempest-TestStampPattern-430277665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:41 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-f20e60d7-db53-485d-a88e-c9ba4ace7703 req-2454d614-bf06-44c9-9772-c45a7b6dd5bd tempest-TestStampPattern-430277665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-1a16af70-0109-40c2-85a1-a12e232b97fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88cc6e7f-49be-4f81-8ba0-ba03f96de2e7', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:11:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-f20e60d7-db53-485d-a88e-c9ba4ace7703 req-2454d614-bf06-44c9-9772-c45a7b6dd5bd tempest-TestStampPattern-430277665 None] attachment_update completed successfully. Aug 26 03:11:45 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-cda025e6-d705-4740-bcdd-555473e338e0 req-6caca8f4-09e3-4ac8-802b-db4358771191 tempest-TestStampPattern-430277665 None] Terminate volume connection completed successfully. Aug 26 03:11:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-cda025e6-d705-4740-bcdd-555473e338e0 req-6caca8f4-09e3-4ac8-802b-db4358771191 tempest-TestStampPattern-430277665 None] Deleting attachment 88cc6e7f-49be-4f81-8ba0-ba03f96de2e7. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:11:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-1a16af70-0109-40c2-85a1-a12e232b97fb-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Lock "cinder-1a16af70-0109-40c2-85a1-a12e232b97fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-quobyte-1a16af70-0109-40c2-85a1-a12e232b97fb" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-1a16af70-0109-40c2-85a1-a12e232b97fb" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:49 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd957d-bdbb-4916-b2bc-6ee7e15bdbde]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:49 devstack sudo[110631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb Aug 26 03:11:49 devstack sudo[110631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:50 devstack sudo[110631]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb" returned: 0 in 0.415s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:50 devstack sudo[110636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb Aug 26 03:11:50 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:50 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1a16af70-0109-40c2-85a1-a12e232b97fb" returned: 0 in 0.318s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-1a16af70-0109-40c2-85a1-a12e232b97fb" released by "delete_volume" :: held 0.779s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Created reservations ['6e0a79ca-d6a6-4bce-aa90-4eadca12e853', '59f83873-189a-429a-b3cc-5a17796ae9e8', 'c406a4b5-dbed-4293-81f8-aa2486bbbbac', 'bb521136-b77d-4a4d-b28a-a8397a10450c'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:50 devstack sudo[110639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:11:50 devstack sudo[110639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:50 devstack sudo[110639]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.310s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Deleted volume successfully. Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-236b2e30-27a0-4325-aba1-a5eb6e47fb88 tempest-TestStampPattern-430277665 None] Lock "cinder-1a16af70-0109-40c2-85a1-a12e232b97fb-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-180783d0-ab9f-4a87-b2c3-d2ad1ad31439-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Lock "cinder-180783d0-ab9f-4a87-b2c3-d2ad1ad31439-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-quobyte-a910c15a-8b7a-49a0-888c-6af0f7341b4f" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-a910c15a-8b7a-49a0-888c-6af0f7341b4f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-quobyte-180783d0-ab9f-4a87-b2c3-d2ad1ad31439" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-180783d0-ab9f-4a87-b2c3-d2ad1ad31439" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Deleting offline snapshot 180783d0-ab9f-4a87-b2c3-d2ad1ad31439 of volume a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] snapshot_file for this snap is: volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62f3d0a-8f5d-4c7f-b69b-92e8e0aa20b2]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:51 devstack sudo[110642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 Aug 26 03:11:51 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:51 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439" returned: 0 in 0.420s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceea590-4a9a-4468-ab6a-87355c904568]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:51 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f Aug 26 03:11:51 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:52 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f" returned: 0 in 0.725s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:52 devstack sudo[110686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 Aug 26 03:11:52 devstack sudo[110686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:52 devstack sudo[110686]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439" returned: 0 in 0.549s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:52 devstack sudo[110693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439 Aug 26 03:11:52 devstack sudo[110693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:53 devstack sudo[110693]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f.180783d0-ab9f-4a87-b2c3-d2ad1ad31439" returned: 0 in 0.337s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-180783d0-ab9f-4a87-b2c3-d2ad1ad31439" released by "_delete_snapshot" :: held 2.185s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-a910c15a-8b7a-49a0-888c-6af0f7341b4f" released by "delete_snapshot" :: held 2.216s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:53 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Created reservations ['67fb049b-ed37-4ab9-96a6-75722c5ba227', '2828d8bc-4851-4ac2-9d42-5ea838208441', 'b71b80d4-2355-4414-9a55-f7731ecbf9d3', '7ee98ec5-c27f-4792-941f-e739b8419446'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Delete snapshot completed successfully. Aug 26 03:11:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2fb9e007-ebc8-4770-885b-e057b28c55c3 tempest-TestStampPattern-430277665 None] Lock "cinder-180783d0-ab9f-4a87-b2c3-d2ad1ad31439-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-a910c15a-8b7a-49a0-888c-6af0f7341b4f-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Lock "cinder-a910c15a-8b7a-49a0-888c-6af0f7341b4f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Acquiring lock "cinder-quobyte-a910c15a-8b7a-49a0-888c-6af0f7341b4f" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-a910c15a-8b7a-49a0-888c-6af0f7341b4f" acquired by "delete_volume" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:58 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0867e813-569b-4d5d-9c71-88f4f6515f42]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:58 devstack sudo[110724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f Aug 26 03:11:58 devstack sudo[110724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:59 devstack sudo[110724]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f" returned: 0 in 0.414s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:59 devstack sudo[110729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f Aug 26 03:11:59 devstack sudo[110729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:59 devstack sudo[110729]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a910c15a-8b7a-49a0-888c-6af0f7341b4f" returned: 0 in 0.296s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Lock "cinder-quobyte-a910c15a-8b7a-49a0-888c-6af0f7341b4f" released by "delete_volume" :: held 0.770s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Created reservations ['009838fe-9c0b-4842-8f84-43a64aab564a', 'c1dec31f-fbea-4f28-9147-c404de902337', '6088cdda-a290-45fc-9141-2af87aa87f96', '8a0398a4-a645-4368-bbe2-66e236fd0038'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:59 devstack sudo[110738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:11:59 devstack sudo[110738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:59 devstack sudo[110738]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.286s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Deleted volume successfully. Aug 26 03:11:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b12d0840-fde0-4241-bfc7-393d3986991e tempest-TestStampPattern-430277665 None] Lock "cinder-a910c15a-8b7a-49a0-888c-6af0f7341b4f-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:02 devstack sudo[110745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:12:02 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:02 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.307s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:12:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:12:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=23,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:12:09 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (438d4184-a9fa-4de6-b83f-15543a0b3184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44da33b8-cd51-444d-9f4e-23570120b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44da33b8-cd51-444d-9f4e-23570120b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985373014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94c6a2d-fbbb-4076-b508-1a45bae21ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:16Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37caa4a-cd87-4225-8833-5629d40d0ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37caa4a-cd87-4225-8833-5629d40d0ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cce7d3-962b-4e7a-baf5-c822a6c4f340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cce7d3-962b-4e7a-baf5-c822a6c4f340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94c6a2d-fbbb-4076-b508-1a45bae21ede', 'volume_name': 'volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04feba1-ff1d-462e-b253-2fd7d91fca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04feba1-ff1d-462e-b253-2fd7d91fca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372b71a8-b6c2-47bb-83e8-1e9d9d877e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:16 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume a94c6a2d-fbbb-4076-b508-1a45bae21ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede', 'volume_size': 1} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985373014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94c6a2d-fbbb-4076-b508-1a45bae21ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:16Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Creating volume a94c6a2d-fbbb-4076-b508-1a45bae21ede {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:16 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:16 devstack sudo[110855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede 1073741824 Aug 26 03:12:16 devstack sudo[110855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:16 devstack sudo[110855]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede 1073741824" returned: 0 in 0.478s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:17 devstack sudo[110860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede Aug 26 03:12:17 devstack sudo[110860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:17 devstack sudo[110860]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372b71a8-b6c2-47bb-83e8-1e9d9d877e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e05789-6aaf-43a5-8232-b3a1834882c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:17 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede (a94c6a2d-fbbb-4076-b508-1a45bae21ede): created successfully Aug 26 03:12:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e05789-6aaf-43a5-8232-b3a1834882c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:17 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (438d4184-a9fa-4de6-b83f-15543a0b3184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-136fe3d7-dcf6-4318-b851-2f6524527c24 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created volume successfully. Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (3824101f-74e5-410d-a166-8fda6399ea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0546f47-6a3a-41ac-ac21-2b0a9f6a200d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0546f47-6a3a-41ac-ac21-2b0a9f6a200d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692787988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267493ad-0af0-427a-9e60-14d8b6c0aad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:19Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cd7349-16b1-4291-ad02-218e8c2292cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cd7349-16b1-4291-ad02-218e8c2292cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886a3884-9f38-4bce-9b33-c8dd18f86140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886a3884-9f38-4bce-9b33-c8dd18f86140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267493ad-0af0-427a-9e60-14d8b6c0aad2', 'volume_name': 'volume-267493ad-0af0-427a-9e60-14d8b6c0aad2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a9c418-92c8-4c70-9f36-78527c002b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a9c418-92c8-4c70-9f36-78527c002b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a973095-1f13-4a43-bf94-e353da465a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume 267493ad-0af0-427a-9e60-14d8b6c0aad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267493ad-0af0-427a-9e60-14d8b6c0aad2', 'volume_size': 1} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692787988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267493ad-0af0-427a-9e60-14d8b6c0aad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:19Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Creating volume 267493ad-0af0-427a-9e60-14d8b6c0aad2 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:19 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:19 devstack sudo[110863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 1073741824 Aug 26 03:12:19 devstack sudo[110863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (ce1b2f58-c365-4ace-bf6f-31c62aa2c463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd43475-3524-459c-93e0-6d0b0cd2d313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd43475-3524-459c-93e0-6d0b0cd2d313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276280043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdb8c36-1a33-483c-aa87-85328ee92e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:20Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeb76c2-d13f-46de-a68b-4d045937988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeb76c2-d13f-46de-a68b-4d045937988c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a50afa-0ac0-4003-bacf-6e139674174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a50afa-0ac0-4003-bacf-6e139674174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fdb8c36-1a33-483c-aa87-85328ee92e8c', 'volume_name': 'volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272a03b2-e03e-4ae4-a87d-00729991d4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272a03b2-e03e-4ae4-a87d-00729991d4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd043b49-d301-4ba0-8e17-62b33dcf35f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:19 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume 2fdb8c36-1a33-483c-aa87-85328ee92e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c', 'volume_size': 1} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:19 devstack sudo[110863]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 1073741824" returned: 0 in 0.663s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:20 devstack sudo[110869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 Aug 26 03:12:20 devstack sudo[110869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (40391629-f4fe-4aed-9d0c-8f0773406174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78839c93-bf69-40bf-b031-3755bd6aff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78839c93-bf69-40bf-b031-3755bd6aff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964096097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2460379a-df06-4977-9bf5-0a751977127d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:20Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1aa5362-bb03-44d0-b69b-2ac658753058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1aa5362-bb03-44d0-b69b-2ac658753058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d981c600-9fd0-4678-a1aa-a0e7acd72c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d981c600-9fd0-4678-a1aa-a0e7acd72c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2460379a-df06-4977-9bf5-0a751977127d', 'volume_name': 'volume-2460379a-df06-4977-9bf5-0a751977127d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d65fdec-15ff-418c-86e5-2c88e7a2fa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d65fdec-15ff-418c-86e5-2c88e7a2fa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583fdb0d-1860-4bb7-879f-c058467436da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume 2460379a-df06-4977-9bf5-0a751977127d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2460379a-df06-4977-9bf5-0a751977127d', 'volume_size': 1} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:20 devstack sudo[110869]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2" returned: 0 in 0.413s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276280043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdb8c36-1a33-483c-aa87-85328ee92e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:20Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Creating volume 2fdb8c36-1a33-483c-aa87-85328ee92e8c {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:20 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a973095-1f13-4a43-bf94-e353da465a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267493ad-0af0-427a-9e60-14d8b6c0aad2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def440cc-8ef1-4531-bc57-4b1b2542888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack sudo[110872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c 1073741824 Aug 26 03:12:20 devstack sudo[110872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:20 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 (267493ad-0af0-427a-9e60-14d8b6c0aad2): created successfully Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def440cc-8ef1-4531-bc57-4b1b2542888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (3824101f-74e5-410d-a166-8fda6399ea6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f7467cc6-e857-4907-81d8-b47e37b1a10a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created volume successfully. Aug 26 03:12:20 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (36254228-a720-434a-b073-ba394282db92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59b2725-e1b1-47a2-8a17-6dac4469ff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59b2725-e1b1-47a2-8a17-6dac4469ff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-715122768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de148800-eea5-4432-89f4-857fe967b6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:21Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e26b8d1-87b3-43f6-ade3-d1bf13c9a1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e26b8d1-87b3-43f6-ade3-d1bf13c9a1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dc39e1-90cb-4179-9fd7-9aec7dbad1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dc39e1-90cb-4179-9fd7-9aec7dbad1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de148800-eea5-4432-89f4-857fe967b6fd', 'volume_name': 'volume-de148800-eea5-4432-89f4-857fe967b6fd', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db191b58-2a1a-417a-90a5-b7ea3975e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db191b58-2a1a-417a-90a5-b7ea3975e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f967d0d-0db9-4238-8408-85cf972679a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume de148800-eea5-4432-89f4-857fe967b6fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de148800-eea5-4432-89f4-857fe967b6fd', 'volume_size': 1} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:21 devstack sudo[110872]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c 1073741824" returned: 0 in 0.793s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:21 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c Aug 26 03:12:21 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:21 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (ed95802f-b11a-4383-91b0-a7952b73c775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f07bc8a-b949-436d-b5c7-a8b68223d2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c" returned: 0 in 0.420s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964096097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2460379a-df06-4977-9bf5-0a751977127d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:20Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Creating volume 2460379a-df06-4977-9bf5-0a751977127d {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:21 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f07bc8a-b949-436d-b5c7-a8b68223d2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066425002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd0484b-170b-4320-b145-5b9b200bd141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:21Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b01572-7e6d-4cad-992c-2fd42835f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b01572-7e6d-4cad-992c-2fd42835f07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack sudo[110907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d 1073741824 Aug 26 03:12:21 devstack sudo[110907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76fd22b-4c7e-4117-a1b1-c6ce46139766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76fd22b-4c7e-4117-a1b1-c6ce46139766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd0484b-170b-4320-b145-5b9b200bd141', 'volume_name': 'volume-4bd0484b-170b-4320-b145-5b9b200bd141', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed09b55-1a9e-40b1-a7a4-6bcd2d425639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed09b55-1a9e-40b1-a7a4-6bcd2d425639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac33582-64d8-4132-a349-dfba3b9b7ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume 4bd0484b-170b-4320-b145-5b9b200bd141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd0484b-170b-4320-b145-5b9b200bd141', 'volume_size': 1} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd043b49-d301-4ba0-8e17-62b33dcf35f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2515dc-fd76-42fb-89ec-4d7a70a9170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c (2fdb8c36-1a33-483c-aa87-85328ee92e8c): created successfully Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2515dc-fd76-42fb-89ec-4d7a70a9170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (ce1b2f58-c365-4ace-bf6f-31c62aa2c463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:21 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5512dc5f-681c-4809-bd29-85e9bc308f8e tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created volume successfully. Aug 26 03:12:22 devstack sudo[110907]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d 1073741824" returned: 0 in 0.552s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:22 devstack sudo[110913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d Aug 26 03:12:22 devstack sudo[110913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:22 devstack sudo[110913]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d" returned: 0 in 0.314s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-715122768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de148800-eea5-4432-89f4-857fe967b6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:21Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Creating volume de148800-eea5-4432-89f4-857fe967b6fd {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:22 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583fdb0d-1860-4bb7-879f-c058467436da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2460379a-df06-4977-9bf5-0a751977127d', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:22 devstack sudo[110916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd 1073741824 Aug 26 03:12:22 devstack sudo[110916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d29801-ccdd-4cf8-9dbf-b4db6ea2c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:22 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume volume-2460379a-df06-4977-9bf5-0a751977127d (2460379a-df06-4977-9bf5-0a751977127d): created successfully Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d29801-ccdd-4cf8-9dbf-b4db6ea2c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (40391629-f4fe-4aed-9d0c-8f0773406174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:22 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-581130b7-bcf8-457b-8c80-c3328827f062 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created volume successfully. Aug 26 03:12:23 devstack sudo[110916]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd 1073741824" returned: 0 in 0.519s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:23 devstack sudo[110922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd Aug 26 03:12:23 devstack sudo[110922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:23 devstack sudo[110922]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd" returned: 0 in 0.307s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066425002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd0484b-170b-4320-b145-5b9b200bd141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b449124144044ac09ccee4e1c744e696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:21Z,use_quota=True,user_id='1aac5acbd79f4295a25edf83a7caeaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Creating volume 4bd0484b-170b-4320-b145-5b9b200bd141 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:23 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:23 devstack sudo[110925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 1073741824 Aug 26 03:12:23 devstack sudo[110925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f967d0d-0db9-4238-8408-85cf972679a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de148800-eea5-4432-89f4-857fe967b6fd', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3625baf-76c8-4b37-beae-63558a752e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:23 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume volume-de148800-eea5-4432-89f4-857fe967b6fd (de148800-eea5-4432-89f4-857fe967b6fd): created successfully Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3625baf-76c8-4b37-beae-63558a752e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (36254228-a720-434a-b073-ba394282db92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:23 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-947e79ed-2232-47a0-a1aa-be525c9529b9 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created volume successfully. Aug 26 03:12:24 devstack sudo[110925]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 1073741824" returned: 0 in 0.530s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:24 devstack sudo[110931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 Aug 26 03:12:24 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:24 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141" returned: 0 in 0.324s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac33582-64d8-4132-a349-dfba3b9b7ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd0484b-170b-4320-b145-5b9b200bd141', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c260a868-0998-414f-83e0-f2d0ed5a22b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Volume volume-4bd0484b-170b-4320-b145-5b9b200bd141 (4bd0484b-170b-4320-b145-5b9b200bd141): created successfully Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c260a868-0998-414f-83e0-f2d0ed5a22b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Flow 'volume_create_manager' (ed95802f-b11a-4383-91b0-a7952b73c775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:24 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a51b819d-7d39-4e08-8d62-dcb5308400e2 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created volume successfully. Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-4bd0484b-170b-4320-b145-5b9b200bd141-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-4bd0484b-170b-4320-b145-5b9b200bd141-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-quobyte-4bd0484b-170b-4320-b145-5b9b200bd141" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-4bd0484b-170b-4320-b145-5b9b200bd141" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c7477d-87b3-40e5-966a-c392b9281159]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:25 devstack sudo[110934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 Aug 26 03:12:25 devstack sudo[110934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:25 devstack sudo[110934]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141" returned: 0 in 0.397s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:25 devstack sudo[110939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141 Aug 26 03:12:25 devstack sudo[110939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:25 devstack sudo[110939]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4bd0484b-170b-4320-b145-5b9b200bd141" returned: 0 in 0.277s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-4bd0484b-170b-4320-b145-5b9b200bd141" released by "delete_volume" :: held 0.720s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:25 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created reservations ['639b6dbc-4912-4ffc-91e3-76f6614de8fb', 'f261119c-57c7-478b-9209-21f82bce49b6', '55352083-fd91-4737-8d20-c6c11d47c4d9', '94aee9d3-14f3-4a93-9e2c-894bce514e6e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:26 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:12:26 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-de148800-eea5-4432-89f4-857fe967b6fd-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-de148800-eea5-4432-89f4-857fe967b6fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:26 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.314s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Deleted volume successfully. Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-quobyte-de148800-eea5-4432-89f4-857fe967b6fd" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-de148800-eea5-4432-89f4-857fe967b6fd" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-77b65f7e-5e21-48e9-9f64-061004bc04dc tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-4bd0484b-170b-4320-b145-5b9b200bd141-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f6f31c-74d7-4422-801e-89edcbb1f236]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:26 devstack sudo[110946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd Aug 26 03:12:26 devstack sudo[110946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:26 devstack sudo[110946]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd" returned: 0 in 0.428s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:26 devstack sudo[110951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd Aug 26 03:12:26 devstack sudo[110951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:27 devstack sudo[110951]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-de148800-eea5-4432-89f4-857fe967b6fd" returned: 0 in 0.283s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-de148800-eea5-4432-89f4-857fe967b6fd" released by "delete_volume" :: held 0.764s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created reservations ['ffc959f6-b7c1-443a-b174-263d3e40670c', '16883093-92d4-4643-84ed-99590cdd6c18', '47023783-3320-4783-bee3-2c1d6ac2f10d', 'cac34758-5917-4eef-9f9d-084d95c6845b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:27 devstack sudo[110954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:12:27 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-2460379a-df06-4977-9bf5-0a751977127d-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-2460379a-df06-4977-9bf5-0a751977127d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-quobyte-2460379a-df06-4977-9bf5-0a751977127d" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-2460379a-df06-4977-9bf5-0a751977127d" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:27 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.328s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:27 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Deleted volume successfully. Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcb16e4-b62e-4667-a07e-078d24ba66db]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b084046d-3515-43c8-8d47-b644ca5ee499 tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-de148800-eea5-4432-89f4-857fe967b6fd-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:27 devstack sudo[110957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d Aug 26 03:12:27 devstack sudo[110957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:28 devstack sudo[110957]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d" returned: 0 in 0.407s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:28 devstack sudo[110962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d Aug 26 03:12:28 devstack sudo[110962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:28 devstack sudo[110962]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2460379a-df06-4977-9bf5-0a751977127d" returned: 0 in 0.286s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-2460379a-df06-4977-9bf5-0a751977127d" released by "delete_volume" :: held 0.749s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created reservations ['9bf2630d-feda-4764-941e-0ebef7727d4b', '56c5dd4e-263e-4895-a7e1-9976653646d3', '42be4bb2-145e-4e4f-be28-502d0878e0a2', '90e8ceed-e61b-4238-b627-23c9fc7a5ab9'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:28 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:12:28 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-2fdb8c36-1a33-483c-aa87-85328ee92e8c-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-2fdb8c36-1a33-483c-aa87-85328ee92e8c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-quobyte-2fdb8c36-1a33-483c-aa87-85328ee92e8c" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-2fdb8c36-1a33-483c-aa87-85328ee92e8c" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:28 devstack sudo[110965]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Deleted volume successfully. Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e17e73a-4763-4a65-a869-6e7481a359bd]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-be6e683b-4ba3-4643-9a54-c9210765ccff tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-2460379a-df06-4977-9bf5-0a751977127d-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:28 devstack sudo[110968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c Aug 26 03:12:28 devstack sudo[110968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:29 devstack sudo[110968]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c" returned: 0 in 0.422s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:29 devstack sudo[110974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c Aug 26 03:12:29 devstack sudo[110974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:29 devstack sudo[110974]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-2fdb8c36-1a33-483c-aa87-85328ee92e8c" returned: 0 in 0.274s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-2fdb8c36-1a33-483c-aa87-85328ee92e8c" released by "delete_volume" :: held 0.760s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created reservations ['09842399-dd2a-4e60-93c6-d2a248f0ba99', 'f58ad37e-2908-4146-a901-1a537bd4af26', 'cd3e1b3d-7076-4cd7-a070-5e87c705dcf9', 'ff6165e1-26d9-448a-8539-b48f06fb00a3'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:29 devstack sudo[110977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:12:29 devstack sudo[110977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-267493ad-0af0-427a-9e60-14d8b6c0aad2-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-267493ad-0af0-427a-9e60-14d8b6c0aad2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-quobyte-267493ad-0af0-427a-9e60-14d8b6c0aad2" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-267493ad-0af0-427a-9e60-14d8b6c0aad2" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:30 devstack sudo[110977]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.311s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Deleted volume successfully. Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdefc4a-231c-4d1f-b714-7f3b3ecbc26a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9c8e69f3-e3f3-47c6-a43d-1948b1d15c8b tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-2fdb8c36-1a33-483c-aa87-85328ee92e8c-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:30 devstack sudo[110980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 Aug 26 03:12:30 devstack sudo[110980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:30 devstack sudo[110980]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2" returned: 0 in 0.420s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:30 devstack sudo[110985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2 Aug 26 03:12:30 devstack sudo[110985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:30 devstack sudo[110985]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-267493ad-0af0-427a-9e60-14d8b6c0aad2" returned: 0 in 0.295s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-267493ad-0af0-427a-9e60-14d8b6c0aad2" released by "delete_volume" :: held 0.790s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created reservations ['080b69f5-1722-4ed5-9662-33d0b276225f', '3c1228d6-af49-4f42-bcce-7134c16279f4', 'd04ff581-7450-437b-a4a5-6f25c5978094', 'ee45a7e3-4c9b-4f33-9873-964ae1f74738'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:30 devstack sudo[110988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:12:30 devstack sudo[110988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-a94c6a2d-fbbb-4076-b508-1a45bae21ede-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-a94c6a2d-fbbb-4076-b508-1a45bae21ede-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "cinder-quobyte-a94c6a2d-fbbb-4076-b508-1a45bae21ede" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-a94c6a2d-fbbb-4076-b508-1a45bae21ede" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:31 devstack sudo[110988]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.355s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Deleted volume successfully. Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd317f6d-42fd-4993-9d0f-8a625cc993c7]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e02b0727-d420-4e32-83b0-30555dd043cf tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-267493ad-0af0-427a-9e60-14d8b6c0aad2-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:31 devstack sudo[110993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede Aug 26 03:12:31 devstack sudo[110993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:31 devstack sudo[110993]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede" returned: 0 in 0.476s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:31 devstack sudo[110998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede Aug 26 03:12:31 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:32 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a94c6a2d-fbbb-4076-b508-1a45bae21ede" returned: 0 in 0.288s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-quobyte-a94c6a2d-fbbb-4076-b508-1a45bae21ede" released by "delete_volume" :: held 0.830s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Created reservations ['8765f199-e4ae-4c1c-9cf2-6340d79e6ad3', 'ee4a7efc-4c90-4431-bbda-832f32e3b29b', '4978e39a-145a-4a2d-97a3-86e2eceab62e', 'b558b234-4492-4865-901f-10da7bcdeda5'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:32 devstack sudo[111001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:12:32 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Flow 'volume_create_manager' (53ca0ce3-2ae0-4956-a6cc-65421887b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f1e71f-bb00-4f25-89bb-b9293822d8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:32 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f1e71f-bb00-4f25-89bb-b9293822d8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-830224136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581f65a6-f231-4ed1-bf78-7a4c9e2a6014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e075a4ba964519ad973b9966e42382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:32Z,use_quota=True,user_id='93445247296e4632a112268854e0075a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411d6e29-2fa8-4e86-babb-dae22b55acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411d6e29-2fa8-4e86-babb-dae22b55acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078aacb1-9c3e-4aca-8165-a971e0536084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078aacb1-9c3e-4aca-8165-a971e0536084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '581f65a6-f231-4ed1-bf78-7a4c9e2a6014', 'volume_name': 'volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac90b015-4838-4d7d-857a-2bd6721a86ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac90b015-4838-4d7d-857a-2bd6721a86ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736befd4-7cf4-448a-86f7-7e5992d0df2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:32 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Volume 581f65a6-f231-4ed1-bf78-7a4c9e2a6014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014', 'volume_size': 1} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-830224136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581f65a6-f231-4ed1-bf78-7a4c9e2a6014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e075a4ba964519ad973b9966e42382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:32Z,use_quota=True,user_id='93445247296e4632a112268854e0075a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Creating volume 581f65a6-f231-4ed1-bf78-7a4c9e2a6014 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:32 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.411s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Deleted volume successfully. Aug 26 03:12:32 devstack sudo[111004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 1073741824 Aug 26 03:12:32 devstack sudo[111004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-00ac807a-5872-487b-aa61-b037da94508a tempest-CreateVolumesFromSourceVolumeTest-475557188 None] Lock "cinder-a94c6a2d-fbbb-4076-b508-1a45bae21ede-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:33 devstack sudo[111004]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 1073741824" returned: 0 in 0.595s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:33 devstack sudo[111010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 Aug 26 03:12:33 devstack sudo[111010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:33 devstack sudo[111010]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014" returned: 0 in 0.308s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736befd4-7cf4-448a-86f7-7e5992d0df2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac83f88-3480-4231-8a3d-2a14632e5ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:33 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Volume volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 (581f65a6-f231-4ed1-bf78-7a4c9e2a6014): created successfully Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac83f88-3480-4231-8a3d-2a14632e5ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Flow 'volume_create_manager' (53ca0ce3-2ae0-4956-a6cc-65421887b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f124d153-cdb9-430e-8947-383c31bea88e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Created volume successfully. Aug 26 03:12:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d7161296-1ffa-4f0e-9755-5f2ac5afdea3 req-7540f419-281b-4439-8682-e6126b9d1e9e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d7161296-1ffa-4f0e-9755-5f2ac5afdea3 req-7540f419-281b-4439-8682-e6126b9d1e9e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-d7161296-1ffa-4f0e-9755-5f2ac5afdea3 req-7540f419-281b-4439-8682-e6126b9d1e9e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-d7161296-1ffa-4f0e-9755-5f2ac5afdea3 req-7540f419-281b-4439-8682-e6126b9d1e9e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b607acf5-bd95-4eb4-b403-00000c1db6d2', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:12:35 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-d7161296-1ffa-4f0e-9755-5f2ac5afdea3 req-7540f419-281b-4439-8682-e6126b9d1e9e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] attachment_update completed successfully. Aug 26 03:12:39 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-65101d3b-cb26-4a4f-93fd-0f1d108213ee req-8461ffb0-99cc-4e41-8227-94587c79e277 tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Terminate volume connection completed successfully. Aug 26 03:12:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-65101d3b-cb26-4a4f-93fd-0f1d108213ee req-8461ffb0-99cc-4e41-8227-94587c79e277 tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Deleting attachment b607acf5-bd95-4eb4-b403-00000c1db6d2. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:12:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Acquiring lock "cinder-581f65a6-f231-4ed1-bf78-7a4c9e2a6014-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "cinder-581f65a6-f231-4ed1-bf78-7a4c9e2a6014-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Acquiring lock "cinder-quobyte-581f65a6-f231-4ed1-bf78-7a4c9e2a6014" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "cinder-quobyte-581f65a6-f231-4ed1-bf78-7a4c9e2a6014" acquired by "delete_volume" :: waited 0.030s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:39 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4309a96-156d-4751-9c5b-77748204e8a9]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:40 devstack sudo[111451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 Aug 26 03:12:40 devstack sudo[111451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:40 devstack sudo[111451]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014" returned: 0 in 0.399s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:40 devstack sudo[111456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014 Aug 26 03:12:40 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:40 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-581f65a6-f231-4ed1-bf78-7a4c9e2a6014" returned: 0 in 0.296s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "cinder-quobyte-581f65a6-f231-4ed1-bf78-7a4c9e2a6014" released by "delete_volume" :: held 0.747s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Created reservations ['a4ca850d-f830-4cb3-bc94-1151fda6e76c', 'b6debc68-7f7b-459f-8b30-d4ab61b2df78', 'f03a1aba-ed72-4c17-9702-b417118a89b3', '01fe2797-84df-4c18-982c-c63a896188da'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:40 devstack sudo[111459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:12:40 devstack sudo[111459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:41 devstack sudo[111459]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.273s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:41 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Deleted volume successfully. Aug 26 03:12:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-666a8cc7-ae30-47f7-a635-fc44cc93ad1e tempest-TestServerVolumeAttachScenarioOldVersion-352069001 None] Lock "cinder-581f65a6-f231-4ed1-bf78-7a4c9e2a6014-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:50 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=60,cinder:INSERT=16,cinder:UPDATE=73,cinder:DELETE=9 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:12:51 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=84,cinder:SELECT=53,cinder:INSERT=19,cinder:DELETE=5 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:02 devstack sudo[111539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:13:02 devstack sudo[111539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:02 devstack sudo[111539]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.274s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:13:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Flow 'volume_create_manager' (e545d313-46ed-46ac-9a98-58781d1f7583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f89c06b-79a2-415e-82f7-6a23bad65dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f89c06b-79a2-415e-82f7-6a23bad65dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-202025658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1a07d8-3cb6-420f-bb6c-82ad530d020d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29f7c92eab64b4890565b4b9258db0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:23Z,use_quota=True,user_id='6b57d7ec1e394c9ca1b4fe295fcfabde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db211e9f-35cb-46ca-9062-5f4e580a859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db211e9f-35cb-46ca-9062-5f4e580a859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8138e6-a0d0-4e27-ba0a-16ecab0dbead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8138e6-a0d0-4e27-ba0a-16ecab0dbead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be1a07d8-3cb6-420f-bb6c-82ad530d020d', 'volume_name': 'volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2264c6-b9c6-4127-a2f7-62515551c5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2264c6-b9c6-4127-a2f7-62515551c5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a471eb-77c4-481d-b96a-f446ca21eeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:23 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Volume be1a07d8-3cb6-420f-bb6c-82ad530d020d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Trying to clone be1a07d8-3cb6-420f-bb6c-82ad530d020d from image 9b965289-a39a-4dbd-8350-71f9403900aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:13:23 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[75708b83-66eb-4f32-8706-ee7cd0865a22]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:24 devstack sudo[111545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD Aug 26 03:13:24 devstack sudo[111545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:24 devstack sudo[111545]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa is fetched for user 6b57d7ec1e394c9ca1b4fe295fcfabde. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59cf77f-4af6-478b-aca0-fe07d430e48e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:24 devstack sudo[111550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD Aug 26 03:13:24 devstack sudo[111550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:24 devstack sudo[111550]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-202025658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1a07d8-3cb6-420f-bb6c-82ad530d020d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29f7c92eab64b4890565b4b9258db0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:23Z,use_quota=True,user_id='6b57d7ec1e394c9ca1b4fe295fcfabde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Creating volume be1a07d8-3cb6-420f-bb6c-82ad530d020d {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:13:24 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:13:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:24 devstack sudo[111555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d 1073741824 Aug 26 03:13:24 devstack sudo[111555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:25 devstack sudo[111555]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d 1073741824" returned: 0 in 0.470s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:25 devstack sudo[111561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d Aug 26 03:13:25 devstack sudo[111561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:25 devstack sudo[111561]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d" returned: 0 in 0.281s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:13:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:25 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Attempting download of 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume be1a07d8-3cb6-420f-bb6c-82ad530d020d. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:13:25 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[044c141f-4876-4dc1-b65c-46a4a7e15846]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_aspxhw2k {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:25 devstack sudo[111564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_aspxhw2k Aug 26 03:13:25 devstack sudo[111564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:26 devstack sudo[111564]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_aspxhw2k" returned: 0 in 0.355s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_aspxhw2k {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:26 devstack sudo[111569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_aspxhw2k Aug 26 03:13:26 devstack sudo[111569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:26 devstack sudo[111569]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_aspxhw2k" returned: 1 in 0.339s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b965289-a39a-4dbd-8350-71f9403900aa_aspxhw2k' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f6b00-c280-4369-ae95-44cfc2245ced]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:26 devstack sudo[111573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD Aug 26 03:13:26 devstack sudo[111573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:26 devstack sudo[111573]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] 9b965289-a39a-4dbd-8350-71f9403900aa was qcow2, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:13:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:26 devstack sudo[111578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d Aug 26 03:13:26 devstack sudo[111578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:28 devstack sudo[111578]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d" returned: 0 in 1.774s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b965289-a39a-4dbd-8350-71f9403900aa_96ycsq72devstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:13:28 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Converted 112.00 MB image at 63.07 MB/s Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:28 devstack sudo[111587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d 1G Aug 26 03:13:28 devstack sudo[111587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:28 devstack sudo[111587]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d 1G" returned: 0 in 0.336s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Downloaded image 9b965289-a39a-4dbd-8350-71f9403900aa ((None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}])) to volume be1a07d8-3cb6-420f-bb6c-82ad530d020d successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Temporary image 9b965289-a39a-4dbd-8350-71f9403900aa for user 6b57d7ec1e394c9ca1b4fe295fcfabde is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Marking volume be1a07d8-3cb6-420f-bb6c-82ad530d020d as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Copying metadata from image 9b965289-a39a-4dbd-8350-71f9403900aa to be1a07d8-3cb6-420f-bb6c-82ad530d020d. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Creating volume glance metadata for volume be1a07d8-3cb6-420f-bb6c-82ad530d020d backed by image 9b965289-a39a-4dbd-8350-71f9403900aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a471eb-77c4-481d-b96a-f446ca21eeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d', 'volume_size': 1, 'image_id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b965289-a39a-4dbd-8350-71f9403900aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dabaf8ea937042959c0ad7588e94e5ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b965289-a39a-4dbd-8350-71f9403900aa', 'created_at': datetime.datetime(2026, 8, 26, 0, 48, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 48, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b965289-a39a-4dbd-8350-71f9403900aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a28008f-6ca9-4211-b0a1-4535076f07ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:29 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Volume volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d (be1a07d8-3cb6-420f-bb6c-82ad530d020d): created successfully Aug 26 03:13:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a28008f-6ca9-4211-b0a1-4535076f07ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Flow 'volume_create_manager' (e545d313-46ed-46ac-9a98-58781d1f7583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b3c18ea7-f0e1-41cc-8edb-60da326279a4 tempest-TestShelveInstance-83478759 None] Created volume successfully. Aug 26 03:13:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f199ba4a-149d-41a0-8940-6b90302f7251 req-37adfa48-1f0d-483b-b5ba-43f6a64b176c tempest-TestShelveInstance-83478759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f199ba4a-149d-41a0-8940-6b90302f7251 req-37adfa48-1f0d-483b-b5ba-43f6a64b176c tempest-TestShelveInstance-83478759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-f199ba4a-149d-41a0-8940-6b90302f7251 req-37adfa48-1f0d-483b-b5ba-43f6a64b176c tempest-TestShelveInstance-83478759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-f199ba4a-149d-41a0-8940-6b90302f7251 req-37adfa48-1f0d-483b-b5ba-43f6a64b176c tempest-TestShelveInstance-83478759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0dca33c-fe79-4b0a-a19f-2b09acec9fb4', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:13:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-f199ba4a-149d-41a0-8940-6b90302f7251 req-37adfa48-1f0d-483b-b5ba-43f6a64b176c tempest-TestShelveInstance-83478759 None] attachment_update completed successfully. Aug 26 03:13:42 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:INSERT=8,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:13:42 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=8 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:02 devstack sudo[112165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:14:02 devstack sudo[112165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:02 devstack sudo[112165]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.279s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:14:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:14:04 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-7578b765-cc56-4f02-85ec-616d9493b8ad req-7b8bfd70-9dae-47d1-9926-92a3448775f3 tempest-TestShelveInstance-83478759 None] Terminate volume connection completed successfully. Aug 26 03:14:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-7578b765-cc56-4f02-85ec-616d9493b8ad req-7b8bfd70-9dae-47d1-9926-92a3448775f3 tempest-TestShelveInstance-83478759 None] Deleting attachment d0dca33c-fe79-4b0a-a19f-2b09acec9fb4. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:14:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1410c965-6e9a-4806-9f0a-293e2d6d4f57 req-7a0e0915-3695-4777-a5ed-913e08f9f38a tempest-TestShelveInstance-83478759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1410c965-6e9a-4806-9f0a-293e2d6d4f57 req-7a0e0915-3695-4777-a5ed-913e08f9f38a tempest-TestShelveInstance-83478759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1410c965-6e9a-4806-9f0a-293e2d6d4f57 req-7a0e0915-3695-4777-a5ed-913e08f9f38a tempest-TestShelveInstance-83478759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-1410c965-6e9a-4806-9f0a-293e2d6d4f57 req-7a0e0915-3695-4777-a5ed-913e08f9f38a tempest-TestShelveInstance-83478759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b', 'name': 'volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23ba8485-457d-4696-8618-ea0525a4f1b2', 'enforce_multipath': True} {{(pid=93797) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:14:07 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-1410c965-6e9a-4806-9f0a-293e2d6d4f57 req-7a0e0915-3695-4777-a5ed-913e08f9f38a tempest-TestShelveInstance-83478759 None] attachment_update completed successfully. Aug 26 03:14:17 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:14:17 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:14:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-bdb6a139-9829-4dba-b891-ef4dc7e41dc2 tempest-TestShelveInstance-83478759 None] Terminate volume connection completed successfully. Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-bdb6a139-9829-4dba-b891-ef4dc7e41dc2 tempest-TestShelveInstance-83478759 None] Deleting attachment 23ba8485-457d-4696-8618-ea0525a4f1b2. {{(pid=93797) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Acquiring lock "cinder-be1a07d8-3cb6-420f-bb6c-82ad530d020d-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Lock "cinder-be1a07d8-3cb6-420f-bb6c-82ad530d020d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Acquiring lock "cinder-quobyte-be1a07d8-3cb6-420f-bb6c-82ad530d020d" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Lock "cinder-quobyte-be1a07d8-3cb6-420f-bb6c-82ad530d020d" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb37d0ef-4d80-4b0b-8d04-d6d6e9c4d15c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:53 devstack sudo[112749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d Aug 26 03:14:53 devstack sudo[112749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:53 devstack sudo[112749]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d" returned: 0 in 0.442s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:53 devstack sudo[112788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d Aug 26 03:14:53 devstack sudo[112788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:54 devstack sudo[112788]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-be1a07d8-3cb6-420f-bb6c-82ad530d020d" returned: 0 in 0.277s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Lock "cinder-quobyte-be1a07d8-3cb6-420f-bb6c-82ad530d020d" released by "delete_volume" :: held 0.769s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG cinder.quota [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Created reservations ['f65c8e87-14d5-407d-9ff4-95d9011a368a', '23ccfb2f-09a7-47c9-8a0b-9282d16ed5b5', '26fa43cb-ef4e-4ac1-8a0a-82741c07a907', 'c5d9d2a9-6ec5-43d2-bd37-580e766982c3'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:54 devstack sudo[112793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:14:54 devstack sudo[112793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:54 devstack sudo[112793]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.323s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG cinder.manager [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:14:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Deleted volume successfully. Aug 26 03:14:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [req-1c9a8215-9e9c-4536-9b6e-9cfdbf2a3db1 req-f459d5d3-10df-4f58-8b18-647e0486674b tempest-TestShelveInstance-83478759 None] Lock "cinder-be1a07d8-3cb6-420f-bb6c-82ad530d020d-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:02 devstack sudo[112809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:15:02 devstack sudo[112809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:02 devstack sudo[112809]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:15:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:15:04 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:15:04 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Flow 'volume_create_manager' (14dbc824-0ff3-4d69-a744-16e009ef62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1e2a41-58a5-43bc-aa03-284f5e3cdc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1e2a41-58a5-43bc-aa03-284f5e3cdc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-708581567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7145779647b1415c9ca24cdc6776948e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:27Z,use_quota=True,user_id='90b880a9a02249ddb3be3f277d753828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4c8f3e-3314-4ede-93ff-bb845290ccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4c8f3e-3314-4ede-93ff-bb845290ccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8da8a97-ad8b-45dc-a336-969bf09d6051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8da8a97-ad8b-45dc-a336-969bf09d6051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0', 'volume_name': 'volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b1a018-8472-4efe-aade-aa2f87af5dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b1a018-8472-4efe-aade-aa2f87af5dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4e306f-7630-4946-8a18-edbc7003d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:27 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Volume 35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0', 'volume_size': 1} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-708581567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7145779647b1415c9ca24cdc6776948e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:27Z,use_quota=True,user_id='90b880a9a02249ddb3be3f277d753828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Creating volume 35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:15:27 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:27 devstack sudo[112818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 1073741824 Aug 26 03:15:27 devstack sudo[112818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:27 devstack sudo[112818]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 1073741824" returned: 0 in 0.448s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:28 devstack sudo[112823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 Aug 26 03:15:28 devstack sudo[112823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:28 devstack sudo[112823]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" returned: 0 in 0.275s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:15:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4e306f-7630-4946-8a18-edbc7003d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fd5ea6-9ffd-43fd-a4e2-5129092872ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Volume volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 (35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0): created successfully Aug 26 03:15:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fd5ea6-9ffd-43fd-a4e2-5129092872ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Flow 'volume_create_manager' (14dbc824-0ff3-4d69-a744-16e009ef62c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:15:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-64dd1196-749f-4e04-bb70-c6fad721c1ea tempest-TestImageHashVerification-1622590972 None] Created volume successfully. Aug 26 03:15:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:29 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1211123-38c1-4baa-836f-6607670ddca0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:15:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:29 devstack sudo[112826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 Aug 26 03:15:29 devstack sudo[112826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:30 devstack sudo[112826]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" returned: 0 in 0.392s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:30 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c26e6d-5ec5-4688-8047-d573f4e1c441]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:15:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:30 devstack sudo[112831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 Aug 26 03:15:30 devstack sudo[112831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:30 devstack sudo[112831]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" returned: 0 in 0.408s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 /opt/stack/data/cinder/conversion/35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0.temp_image.333ba870-8e94-4d36-acbb-98b94a965aebb0a4evkc.img {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:30 devstack sudo[112836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 /opt/stack/data/cinder/conversion/35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0.temp_image.333ba870-8e94-4d36-acbb-98b94a965aebb0a4evkc.img Aug 26 03:15:30 devstack sudo[112836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:34 devstack sudo[112836]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 /opt/stack/data/cinder/conversion/35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0.temp_image.333ba870-8e94-4d36-acbb-98b94a965aebb0a4evkc.img" returned: 0 in 4.249s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:34 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55f5ac7-59ac-410d-8bd0-deb3d13af146]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:15:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:34 devstack sudo[112849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 Aug 26 03:15:34 devstack sudo[112849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:35 devstack sudo[112849]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" returned: 0 in 0.565s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:35 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/conversion/35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0.temp_image.333ba870-8e94-4d36-acbb-98b94a965aebb0a4evkc.img {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:15:35 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Converted 1024.00 MB image at 240.94 MB/s Aug 26 03:15:35 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] 333ba870-8e94-4d36-acbb-98b94a965aeb was raw, no need to convert to raw {{(pid=93797) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 03:15:45 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:15:45 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:15:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.342s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Uploaded volume to glance image-id: 333ba870-8e94-4d36-acbb-98b94a965aeb. {{(pid=93797) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 03:15:55 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0dd7c3ef-64b5-450d-aa74-fd3193a4e3ad tempest-TestImageHashVerification-1622590972 None] Copy volume to image completed successfully. Aug 26 03:15:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Acquiring lock "cinder-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:15:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Lock "cinder-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:15:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Acquiring lock "cinder-quobyte-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:15:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Lock "cinder-quobyte-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:15:56 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e7529d-cb46-48e4-8031-84cd6c36612d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:15:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:56 devstack sudo[112900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 Aug 26 03:15:56 devstack sudo[112900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:56 devstack sudo[112900]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" returned: 0 in 0.411s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:56 devstack sudo[112905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0 Aug 26 03:15:56 devstack sudo[112905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:57 devstack sudo[112905]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" returned: 0 in 0.256s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Lock "cinder-quobyte-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0" released by "delete_volume" :: held 0.712s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Created reservations ['4dedd812-ad14-4b46-8095-34e1121e8c6f', 'c987e9b5-37ef-474a-9509-7d75601c939d', 'dcdce4bf-80ea-427c-8cfd-48a536344795', '63585095-3aa5-4049-946b-6e54395b3fcf'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:57 devstack sudo[112908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:15:57 devstack sudo[112908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:57 devstack sudo[112908]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.300s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:15:57 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Deleted volume successfully. Aug 26 03:15:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-b360c4f1-0f8b-4290-9f7d-f0c9f94ca1f7 tempest-TestImageHashVerification-1622590972 None] Lock "cinder-35aab20a-6ad6-4d1e-a4d9-c637efa6b3b0-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:02 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:16:02 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:02 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.266s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:16:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:16:07 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:16:07 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Flow 'volume_create_manager' (05233386-63a7-40a1-9aa4-48da011c9c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dfd8d8-aa6f-462d-bb49-a5a676dfdace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dfd8d8-aa6f-462d-bb49-a5a676dfdace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-256254399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3f4515-2335-4046-b6ee-9af0bf8877e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32d6baee05c44feb8677675f36ab903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:10Z,use_quota=True,user_id='bedd2edcadb149df9af061537bcebd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749b3fb1-2cd8-4e17-bd4d-87dc1e63f545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749b3fb1-2cd8-4e17-bd4d-87dc1e63f545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d25cfa3-b73c-4390-9a7b-93f9c386f713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d25cfa3-b73c-4390-9a7b-93f9c386f713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3f4515-2335-4046-b6ee-9af0bf8877e9', 'volume_name': 'volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971ebe6e-0635-48db-9ea8-0c0fc04cce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971ebe6e-0635-48db-9ea8-0c0fc04cce9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cff374c-4721-4599-9bce-58f763139412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:10 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Volume 5c3f4515-2335-4046-b6ee-9af0bf8877e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9', 'volume_size': 1} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-256254399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3f4515-2335-4046-b6ee-9af0bf8877e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32d6baee05c44feb8677675f36ab903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:10Z,use_quota=True,user_id='bedd2edcadb149df9af061537bcebd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Creating volume 5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:10 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:16:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:10 devstack sudo[112925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 1073741824 Aug 26 03:16:10 devstack sudo[112925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:11 devstack sudo[112925]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 1073741824" returned: 0 in 0.464s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:11 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 Aug 26 03:16:11 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:11 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9" returned: 0 in 0.280s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cff374c-4721-4599-9bce-58f763139412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce4d3c0-d350-4daa-b850-8a7101e69f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:11 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Volume volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 (5c3f4515-2335-4046-b6ee-9af0bf8877e9): created successfully Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce4d3c0-d350-4daa-b850-8a7101e69f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Flow 'volume_create_manager' (05233386-63a7-40a1-9aa4-48da011c9c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b5cf815d-8a73-4fc2-8aa9-fd68823e7432 tempest-VolumeDependencyTests-1923805630 None] Created volume successfully. Aug 26 03:16:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Creating offline snapshot dc34723d-e5eb-405a-a5ac-69f117403b52 of volume 5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:16:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f374bdc-4c38-49b7-8577-b584682803f6]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:12 devstack sudo[112933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 Aug 26 03:16:12 devstack sudo[112933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:13 devstack sudo[112933]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9" returned: 0 in 0.393s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:13 devstack sudo[112938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 1G Aug 26 03:16:13 devstack sudo[112938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:13 devstack sudo[112938]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 1G" returned: 0 in 0.421s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:13 devstack sudo[112943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 Aug 26 03:16:13 devstack sudo[112943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:13 devstack sudo[112943]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52" returned: 0 in 0.325s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:13 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 is being set with open permissions: ugo+rw Aug 26 03:16:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:13 devstack sudo[112948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 Aug 26 03:16:13 devstack sudo[112948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:14 devstack sudo[112948]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52" returned: 0 in 0.266s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:14 devstack sudo[112951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.info Aug 26 03:16:14 devstack sudo[112951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:14 devstack sudo[112951]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.info" returned: 0 in 0.275s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:14 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.info is being set with open permissions: ugo+rw Aug 26 03:16:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:14 devstack sudo[112954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.info Aug 26 03:16:14 devstack sudo[112954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:14 devstack sudo[112954]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.info" returned: 0 in 0.282s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:14 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-60c54e1a-a35b-4b30-801c-8dfaecded351 tempest-VolumeDependencyTests-1923805630 None] Create snapshot completed successfully Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Flow 'volume_create_manager' (d2b8bf8f-bc9c-448a-bceb-1cc4774b0ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bba967-8bd4-47a4-8be2-daa82383842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bba967-8bd4-47a4-8be2-daa82383842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1746574175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784af734-6f4b-4ba6-b776-a9e371414e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32d6baee05c44feb8677675f36ab903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc34723d-e5eb-405a-a5ac-69f117403b52,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:16Z,use_quota=True,user_id='bedd2edcadb149df9af061537bcebd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee6be6f-8758-4439-809e-033230d4851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee6be6f-8758-4439-809e-033230d4851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a109c22-be5f-4ee5-9248-756789f54af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a109c22-be5f-4ee5-9248-756789f54af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '784af734-6f4b-4ba6-b776-a9e371414e41', 'volume_name': 'volume-784af734-6f4b-4ba6-b776-a9e371414e41', 'volume_size': 1, 'snapshot_id': 'dc34723d-e5eb-405a-a5ac-69f117403b52'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28f050-82a2-4363-9875-a30fe0d0262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28f050-82a2-4363-9875-a30fe0d0262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a68d56-f9ed-406a-9383-2fd61f20c1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:16 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Volume 784af734-6f4b-4ba6-b776-a9e371414e41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-784af734-6f4b-4ba6-b776-a9e371414e41', 'volume_size': 1, 'snapshot_id': 'dc34723d-e5eb-405a-a5ac-69f117403b52'} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-quobyte-dc34723d-e5eb-405a-a5ac-69f117403b52-784af734-6f4b-4ba6-b776-a9e371414e41" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-dc34723d-e5eb-405a-a5ac-69f117403b52-784af734-6f4b-4ba6-b776-a9e371414e41" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Creating volume 784af734-6f4b-4ba6-b776-a9e371414e41 from snapshot dc34723d-e5eb-405a-a5ac-69f117403b52 {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-quobyte-784af734-6f4b-4ba6-b776-a9e371414e41" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-784af734-6f4b-4ba6-b776-a9e371414e41" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] snapshot: dc34723d-e5eb-405a-a5ac-69f117403b52, volume: 784af734-6f4b-4ba6-b776-a9e371414e41, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e604f53-cee4-4506-a26b-8deedf159dec]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:16 devstack sudo[112958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 Aug 26 03:16:16 devstack sudo[112958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:17 devstack sudo[112958]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52" returned: 0 in 0.439s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c9e246-a015-4f6a-a465-98f1c8bd66ad]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:17 devstack sudo[112963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 Aug 26 03:16:17 devstack sudo[112963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:17 devstack sudo[112963]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9" returned: 0 in 0.417s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:16:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:17 devstack sudo[112968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 Aug 26 03:16:17 devstack sudo[112968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:21 devstack sudo[112968]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41" returned: 0 in 4.286s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:21 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:16:21 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Converted 1024.00 MB image at 238.86 MB/s Aug 26 03:16:21 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 is being set with open permissions: ugo+rw Aug 26 03:16:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:21 devstack sudo[112981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 Aug 26 03:16:21 devstack sudo[112981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:22 devstack sudo[112981]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41" returned: 0 in 0.257s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-784af734-6f4b-4ba6-b776-a9e371414e41" released by "_copy_volume_from_snapshot" :: held 5.486s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-dc34723d-e5eb-405a-a5ac-69f117403b52-784af734-6f4b-4ba6-b776-a9e371414e41" released by "_create_volume_from_snapshot" :: held 5.554s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.573s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a68d56-f9ed-406a-9383-2fd61f20c1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784af734-6f4b-4ba6-b776-a9e371414e41', 'volume_size': 1, 'snapshot_id': 'dc34723d-e5eb-405a-a5ac-69f117403b52'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9879d94-ee14-46d2-a6ce-3bcb1ef7a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:22 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Volume volume-784af734-6f4b-4ba6-b776-a9e371414e41 (784af734-6f4b-4ba6-b776-a9e371414e41): created successfully Aug 26 03:16:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9879d94-ee14-46d2-a6ce-3bcb1ef7a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Flow 'volume_create_manager' (d2b8bf8f-bc9c-448a-bceb-1cc4774b0ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:22 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-169af18b-eca4-4848-8823-8b46df021b37 tempest-VolumeDependencyTests-1923805630 None] Created volume successfully. Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-dc34723d-e5eb-405a-a5ac-69f117403b52-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-dc34723d-e5eb-405a-a5ac-69f117403b52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-quobyte-5c3f4515-2335-4046-b6ee-9af0bf8877e9" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-5c3f4515-2335-4046-b6ee-9af0bf8877e9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-quobyte-dc34723d-e5eb-405a-a5ac-69f117403b52" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-dc34723d-e5eb-405a-a5ac-69f117403b52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Deleting offline snapshot dc34723d-e5eb-405a-a5ac-69f117403b52 of volume 5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] snapshot_file for this snap is: volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[612bf470-dd9e-4dac-99ec-39971c952c4b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:23 devstack sudo[112984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 Aug 26 03:16:23 devstack sudo[112984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:23 devstack sudo[112984]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52" returned: 0 in 0.398s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115e874-d2ac-48fc-a605-a0f861ed56fe]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:23 devstack sudo[112989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 Aug 26 03:16:23 devstack sudo[112989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:24 devstack sudo[112989]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9" returned: 0 in 0.565s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:24 devstack sudo[112995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 Aug 26 03:16:24 devstack sudo[112995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:24 devstack sudo[112995]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52" returned: 0 in 0.346s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:24 devstack sudo[113001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52 Aug 26 03:16:24 devstack sudo[113001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:24 devstack sudo[113001]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9.dc34723d-e5eb-405a-a5ac-69f117403b52" returned: 0 in 0.262s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-dc34723d-e5eb-405a-a5ac-69f117403b52" released by "_delete_snapshot" :: held 1.675s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-5c3f4515-2335-4046-b6ee-9af0bf8877e9" released by "delete_snapshot" :: held 1.700s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Created reservations ['91d8dc93-5a11-477c-8a88-d4f06b6e7848', '5244035a-ca84-415f-97a7-f9ddfa630179', '3a0cb282-8776-43b0-9fed-9919b527b55c', '5ab3d47f-d87a-4bd1-ac3b-74964a3b0849'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:24 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Delete snapshot completed successfully. Aug 26 03:16:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0aa1934d-de37-4d70-b74a-e6fd40b19d35 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-dc34723d-e5eb-405a-a5ac-69f117403b52-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-5c3f4515-2335-4046-b6ee-9af0bf8877e9-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-5c3f4515-2335-4046-b6ee-9af0bf8877e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-quobyte-5c3f4515-2335-4046-b6ee-9af0bf8877e9" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-5c3f4515-2335-4046-b6ee-9af0bf8877e9" acquired by "delete_volume" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:25 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece219f1-5db1-4fb3-a5f1-ac1d0942a9b6]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:25 devstack sudo[113004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 Aug 26 03:16:25 devstack sudo[113004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:25 devstack sudo[113004]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9" returned: 0 in 0.393s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:25 devstack sudo[113009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9 Aug 26 03:16:25 devstack sudo[113009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:26 devstack sudo[113009]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5c3f4515-2335-4046-b6ee-9af0bf8877e9" returned: 0 in 0.266s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-5c3f4515-2335-4046-b6ee-9af0bf8877e9" released by "delete_volume" :: held 0.715s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Created reservations ['b9bfcdd0-f533-4847-84d6-b9c70edd127d', 'd84a00b3-ed7d-4829-b605-18c81ee73223', '0bc46b43-477b-4abd-9163-e2b5d3b668eb', 'b2d51839-3d74-4ae7-b97d-9619ec524cdd'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:26 devstack sudo[113013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:16:26 devstack sudo[113013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:26 devstack sudo[113013]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.260s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-784af734-6f4b-4ba6-b776-a9e371414e41-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Deleted volume successfully. Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-784af734-6f4b-4ba6-b776-a9e371414e41-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fad7f73-849f-4e18-8b75-7b1affcc0cc8 tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-5c3f4515-2335-4046-b6ee-9af0bf8877e9-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "cinder-quobyte-784af734-6f4b-4ba6-b776-a9e371414e41" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-784af734-6f4b-4ba6-b776-a9e371414e41" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db01fa7-01f3-4cba-92f7-e6b55e5d8811]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:26 devstack sudo[113016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 Aug 26 03:16:26 devstack sudo[113016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:27 devstack sudo[113016]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41" returned: 0 in 0.396s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:27 devstack sudo[113021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41 Aug 26 03:16:27 devstack sudo[113021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:27 devstack sudo[113021]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-784af734-6f4b-4ba6-b776-a9e371414e41" returned: 0 in 0.272s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-quobyte-784af734-6f4b-4ba6-b776-a9e371414e41" released by "delete_volume" :: held 0.721s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Created reservations ['55dcb440-d965-4ff8-a1c1-8db682c5098b', '10e77307-9a84-444a-bf52-4f53ec4ba696', 'b2c2470b-1380-4aef-a2f8-a34d93800b9b', '9824dea5-a381-41a6-b74d-f47c825634dc'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:27 devstack sudo[113024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:16:27 devstack sudo[113024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:27 devstack sudo[113024]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.305s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:27 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Deleted volume successfully. Aug 26 03:16:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6dbfadcb-b228-428e-8cba-4aaddf00de2d tempest-VolumeDependencyTests-1923805630 None] Lock "cinder-784af734-6f4b-4ba6-b776-a9e371414e41-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Flow 'volume_create_manager' (3ae540df-e411-4728-85ef-7d2e2c81db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1afa4ef-7529-4296-81d3-7ddd345d526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1afa4ef-7529-4296-81d3-7ddd345d526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785495996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5335c8fc-d530-424c-a4dc-9ab2f79777d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9517f8a687b54bd3905db1273aedca81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:32Z,use_quota=True,user_id='976803095aa14a0a87a4551bea8f31ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a606c841-0df7-4cd6-88f4-cc83b597912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a606c841-0df7-4cd6-88f4-cc83b597912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1188da96-d793-46b4-acbb-fa6cc0ea3b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1188da96-d793-46b4-acbb-fa6cc0ea3b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5335c8fc-d530-424c-a4dc-9ab2f79777d8', 'volume_name': 'volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3239fd82-6147-4987-ba1a-e8edea0e58b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3239fd82-6147-4987-ba1a-e8edea0e58b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506d0862-4cf6-4d19-a209-349628e254bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Volume 5335c8fc-d530-424c-a4dc-9ab2f79777d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8', 'volume_size': 1} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785495996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5335c8fc-d530-424c-a4dc-9ab2f79777d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9517f8a687b54bd3905db1273aedca81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:32Z,use_quota=True,user_id='976803095aa14a0a87a4551bea8f31ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Creating volume 5335c8fc-d530-424c-a4dc-9ab2f79777d8 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:31 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:16:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:31 devstack sudo[113028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 1073741824 Aug 26 03:16:31 devstack sudo[113028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:32 devstack sudo[113028]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 1073741824" returned: 0 in 0.442s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:32 devstack sudo[113033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 Aug 26 03:16:32 devstack sudo[113033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:32 devstack sudo[113033]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8" returned: 0 in 0.270s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506d0862-4cf6-4d19-a209-349628e254bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb5e6db-02f9-4a31-bbd3-8c48a9324684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:32 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Volume volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 (5335c8fc-d530-424c-a4dc-9ab2f79777d8): created successfully Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb5e6db-02f9-4a31-bbd3-8c48a9324684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Flow 'volume_create_manager' (3ae540df-e411-4728-85ef-7d2e2c81db20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d6a2eccd-d1a4-4abd-89e1-0c9c0957496f tempest-ProjectReaderTests-937028950 None] Created volume successfully. Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Acquiring lock "cinder-5335c8fc-d530-424c-a4dc-9ab2f79777d8-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Lock "cinder-5335c8fc-d530-424c-a4dc-9ab2f79777d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Acquiring lock "cinder-quobyte-5335c8fc-d530-424c-a4dc-9ab2f79777d8" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Lock "cinder-quobyte-5335c8fc-d530-424c-a4dc-9ab2f79777d8" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d59bbb-9c38-4806-a6ea-360ccc9f9406]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:33 devstack sudo[113036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 Aug 26 03:16:33 devstack sudo[113036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:33 devstack sudo[113036]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8" returned: 0 in 0.374s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:33 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8 Aug 26 03:16:33 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:33 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-5335c8fc-d530-424c-a4dc-9ab2f79777d8" returned: 0 in 0.252s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Lock "cinder-quobyte-5335c8fc-d530-424c-a4dc-9ab2f79777d8" released by "delete_volume" :: held 0.664s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Created reservations ['5a103b4d-c527-4bd3-9983-bb7f4c9b62aa', '6f3eb1e0-0bbc-41bb-85bc-fc28903a588d', '166426aa-e8fe-4bd7-947f-6d034c30c2e3', 'ac27d6fb-040a-4d2b-85c2-1b3d4c8e6775'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:33 devstack sudo[113044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:16:33 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:34 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.295s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:34 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Deleted volume successfully. Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-ac822891-223a-459f-bffa-0a52867ad0a6 tempest-ProjectReaderTests-937028950 None] Lock "cinder-5335c8fc-d530-424c-a4dc-9ab2f79777d8-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Flow 'volume_create_manager' (998826c3-0f4a-47bd-92f4-93d899d9f404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e0f8e6-6c1d-4b05-b49a-81b02a4dd8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e0f8e6-6c1d-4b05-b49a-81b02a4dd8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067292483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c7c2e7-09c5-4c5f-874a-50d5430b895a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9517f8a687b54bd3905db1273aedca81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:34Z,use_quota=True,user_id='976803095aa14a0a87a4551bea8f31ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8aed34-a530-46eb-87da-756b4c8fe4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8aed34-a530-46eb-87da-756b4c8fe4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502cce04-1f41-475a-bfc3-a82a574045ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502cce04-1f41-475a-bfc3-a82a574045ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c7c2e7-09c5-4c5f-874a-50d5430b895a', 'volume_name': 'volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0953565-19c6-4bfc-8f80-d27718566c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0953565-19c6-4bfc-8f80-d27718566c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9985b5a9-5160-4ec1-a717-7fde09404355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Volume 24c7c2e7-09c5-4c5f-874a-50d5430b895a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a', 'volume_size': 1} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067292483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c7c2e7-09c5-4c5f-874a-50d5430b895a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9517f8a687b54bd3905db1273aedca81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:34Z,use_quota=True,user_id='976803095aa14a0a87a4551bea8f31ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Creating volume 24c7c2e7-09c5-4c5f-874a-50d5430b895a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:34 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:16:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:34 devstack sudo[113049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a 1073741824 Aug 26 03:16:34 devstack sudo[113049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:35 devstack sudo[113049]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a 1073741824" returned: 0 in 0.424s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:35 devstack sudo[113054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a Aug 26 03:16:35 devstack sudo[113054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:35 devstack sudo[113054]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a" returned: 0 in 0.294s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9985b5a9-5160-4ec1-a717-7fde09404355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d87048f-abd7-4d86-9591-172eb2dbcc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:35 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Volume volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a (24c7c2e7-09c5-4c5f-874a-50d5430b895a): created successfully Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d87048f-abd7-4d86-9591-172eb2dbcc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Flow 'volume_create_manager' (998826c3-0f4a-47bd-92f4-93d899d9f404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:35 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-57258d4a-34a3-43be-b09c-3322081eddd5 tempest-ProjectReaderTests-937028950 None] Created volume successfully. Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Acquiring lock "cinder-24c7c2e7-09c5-4c5f-874a-50d5430b895a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Lock "cinder-24c7c2e7-09c5-4c5f-874a-50d5430b895a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Acquiring lock "cinder-quobyte-24c7c2e7-09c5-4c5f-874a-50d5430b895a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Lock "cinder-quobyte-24c7c2e7-09c5-4c5f-874a-50d5430b895a" acquired by "delete_volume" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc3358d-74f9-4412-9c94-4e187523283b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:35 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a Aug 26 03:16:35 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:36 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a" returned: 0 in 0.369s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:36 devstack sudo[113062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a Aug 26 03:16:36 devstack sudo[113062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:36 devstack sudo[113062]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-24c7c2e7-09c5-4c5f-874a-50d5430b895a" returned: 0 in 0.252s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Lock "cinder-quobyte-24c7c2e7-09c5-4c5f-874a-50d5430b895a" released by "delete_volume" :: held 0.662s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Created reservations ['e42e5a15-716f-4309-a2d9-fd3d4d684daf', '5a687029-1e42-4d3b-aad3-bba0baaa792b', '440f078a-d03b-4217-b5c8-e1ef3142712b', '396cc071-61e2-41c6-896e-8eaa4cc57dcf'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:36 devstack sudo[113066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:16:36 devstack sudo[113066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:36 devstack sudo[113066]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.259s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Deleted volume successfully. Aug 26 03:16:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bbb2cc8f-67b8-4dbe-a016-5b79a3e20635 tempest-ProjectReaderTests-937028950 None] Lock "cinder-24c7c2e7-09c5-4c5f-874a-50d5430b895a-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:46 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=53,cinder:SELECT=37,cinder:DELETE=4,cinder:INSERT=11 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:16:46 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=40,cinder:UPDATE=49,cinder:INSERT=14,cinder:DELETE=5 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:02 devstack sudo[113121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:02 devstack sudo[113121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:02 devstack sudo[113121]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.286s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:17:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Flow 'volume_create_manager' (61560f44-1131-48be-a934-168a815cf5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48af6f2-8a72-4080-aea2-fa9aac6f32a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48af6f2-8a72-4080-aea2-fa9aac6f32a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1433764470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b334db9e-e460-4f97-8515-e092cb752f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a4635591d64e1aa22e62b82d25d0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:05Z,use_quota=True,user_id='134d86f71f87486095c231ad573fca9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f6068f-da04-4f94-8cb3-43df0769fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f6068f-da04-4f94-8cb3-43df0769fd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639f70cd-c453-407d-90a8-c3d2a3399e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639f70cd-c453-407d-90a8-c3d2a3399e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b334db9e-e460-4f97-8515-e092cb752f85', 'volume_name': 'volume-b334db9e-e460-4f97-8515-e092cb752f85', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a41ec9b-8b8b-49e5-a3dc-b0cd241651cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a41ec9b-8b8b-49e5-a3dc-b0cd241651cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252a8b91-513c-480a-8a54-08438d03eec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:05 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Volume b334db9e-e460-4f97-8515-e092cb752f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b334db9e-e460-4f97-8515-e092cb752f85', 'volume_size': 1} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1433764470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b334db9e-e460-4f97-8515-e092cb752f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a4635591d64e1aa22e62b82d25d0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:05Z,use_quota=True,user_id='134d86f71f87486095c231ad573fca9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Creating volume b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:05 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:05 devstack sudo[113124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 1073741824 Aug 26 03:17:05 devstack sudo[113124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:05 devstack sudo[113124]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 1073741824" returned: 0 in 0.447s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:06 devstack sudo[113129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 Aug 26 03:17:06 devstack sudo[113129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:06 devstack sudo[113129]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85" returned: 0 in 0.283s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252a8b91-513c-480a-8a54-08438d03eec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b334db9e-e460-4f97-8515-e092cb752f85', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04fafad-c153-4745-9aff-c5fb5b3add92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:06 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Volume volume-b334db9e-e460-4f97-8515-e092cb752f85 (b334db9e-e460-4f97-8515-e092cb752f85): created successfully Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04fafad-c153-4745-9aff-c5fb5b3add92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Flow 'volume_create_manager' (61560f44-1131-48be-a934-168a815cf5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6956f786-e15e-447e-8819-e95e843c6acf tempest-SnapshotDependencyTests-600262078 None] Created volume successfully. Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Creating offline snapshot cbff0d4c-5305-4d53-b317-cfe34fb141d4 of volume b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f57682-928b-4d85-a726-d64bbdd359f0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:06 devstack sudo[113133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 Aug 26 03:17:06 devstack sudo[113133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:07 devstack sudo[113133]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85" returned: 0 in 0.374s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:07 devstack sudo[113138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 1G Aug 26 03:17:07 devstack sudo[113138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:07 devstack sudo[113138]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 1G" returned: 0 in 0.415s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b334db9e-e460-4f97-8515-e092cb752f85 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:07 devstack sudo[113144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b334db9e-e460-4f97-8515-e092cb752f85 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 Aug 26 03:17:07 devstack sudo[113144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:07 devstack sudo[113144]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b334db9e-e460-4f97-8515-e092cb752f85 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4" returned: 0 in 0.289s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:07 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 is being set with open permissions: ugo+rw Aug 26 03:17:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:07 devstack sudo[113149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 Aug 26 03:17:07 devstack sudo[113149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:08 devstack sudo[113149]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4" returned: 0 in 0.247s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:08 devstack sudo[113152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.info Aug 26 03:17:08 devstack sudo[113152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:08 devstack sudo[113152]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.info" returned: 0 in 0.257s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:08 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.info is being set with open permissions: ugo+rw Aug 26 03:17:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:08 devstack sudo[113155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.info Aug 26 03:17:08 devstack sudo[113155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:08 devstack sudo[113155]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.info" returned: 0 in 0.272s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f7408c98-65f6-4d4e-973a-44616de90295 tempest-SnapshotDependencyTests-600262078 None] Create snapshot completed successfully Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Flow 'volume_create_manager' (02051804-b0a7-4863-8613-cae147e88794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f270fd72-a083-430a-972e-76c546a8e04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f270fd72-a083-430a-972e-76c546a8e04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f909e94-8520-416b-9fd7-7eab74d38081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a4635591d64e1aa22e62b82d25d0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cbff0d4c-5305-4d53-b317-cfe34fb141d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:09Z,use_quota=True,user_id='134d86f71f87486095c231ad573fca9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b6747a-5745-4ab9-8df0-382132f8c59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b6747a-5745-4ab9-8df0-382132f8c59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f168b53-9da9-4682-b71c-789a9335785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f168b53-9da9-4682-b71c-789a9335785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f909e94-8520-416b-9fd7-7eab74d38081', 'volume_name': 'volume-7f909e94-8520-416b-9fd7-7eab74d38081', 'volume_size': 1, 'snapshot_id': 'cbff0d4c-5305-4d53-b317-cfe34fb141d4'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b58c79-e0fa-4566-a939-8b387a69f60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b58c79-e0fa-4566-a939-8b387a69f60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bab2a08-f70a-46af-b56b-de0c5447293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:09 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Volume 7f909e94-8520-416b-9fd7-7eab74d38081: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f909e94-8520-416b-9fd7-7eab74d38081', 'volume_size': 1, 'snapshot_id': 'cbff0d4c-5305-4d53-b317-cfe34fb141d4'} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-quobyte-cbff0d4c-5305-4d53-b317-cfe34fb141d4-7f909e94-8520-416b-9fd7-7eab74d38081" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-cbff0d4c-5305-4d53-b317-cfe34fb141d4-7f909e94-8520-416b-9fd7-7eab74d38081" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Creating volume 7f909e94-8520-416b-9fd7-7eab74d38081 from snapshot cbff0d4c-5305-4d53-b317-cfe34fb141d4 {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-quobyte-7f909e94-8520-416b-9fd7-7eab74d38081" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-7f909e94-8520-416b-9fd7-7eab74d38081" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] snapshot: cbff0d4c-5305-4d53-b317-cfe34fb141d4, volume: 7f909e94-8520-416b-9fd7-7eab74d38081, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b3645-8c49-466f-890b-4bffafaf89af]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:09 devstack sudo[113158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 Aug 26 03:17:09 devstack sudo[113158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:10 devstack sudo[113158]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4" returned: 0 in 0.373s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b334db9e-e460-4f97-8515-e092cb752f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[98853d75-0e66-422f-804f-73958435c6b4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:10 devstack sudo[113163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 Aug 26 03:17:10 devstack sudo[113163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:10 devstack sudo[113163]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85" returned: 0 in 0.384s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:17:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:10 devstack sudo[113169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 Aug 26 03:17:10 devstack sudo[113169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:14 devstack sudo[113169]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081" returned: 0 in 4.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:14 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85, size 1024.00 MB, duration 4.31 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:17:14 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Converted 1024.00 MB image at 237.57 MB/s Aug 26 03:17:14 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 is being set with open permissions: ugo+rw Aug 26 03:17:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:14 devstack sudo[113182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 Aug 26 03:17:14 devstack sudo[113182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:14 devstack sudo[113182]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081" returned: 0 in 0.246s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:14 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-7f909e94-8520-416b-9fd7-7eab74d38081" released by "_copy_volume_from_snapshot" :: held 5.414s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-cbff0d4c-5305-4d53-b317-cfe34fb141d4-7f909e94-8520-416b-9fd7-7eab74d38081" released by "_create_volume_from_snapshot" :: held 5.484s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.502s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bab2a08-f70a-46af-b56b-de0c5447293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f909e94-8520-416b-9fd7-7eab74d38081', 'volume_size': 1, 'snapshot_id': 'cbff0d4c-5305-4d53-b317-cfe34fb141d4'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434e5af9-5603-4294-9515-1e1637dc1786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Volume volume-7f909e94-8520-416b-9fd7-7eab74d38081 (7f909e94-8520-416b-9fd7-7eab74d38081): created successfully Aug 26 03:17:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434e5af9-5603-4294-9515-1e1637dc1786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Flow 'volume_create_manager' (02051804-b0a7-4863-8613-cae147e88794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6535ad96-3c41-46ec-8360-e4d9f8e16d28 tempest-SnapshotDependencyTests-600262078 None] Created volume successfully. Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-cbff0d4c-5305-4d53-b317-cfe34fb141d4-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-cbff0d4c-5305-4d53-b317-cfe34fb141d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-quobyte-b334db9e-e460-4f97-8515-e092cb752f85" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-b334db9e-e460-4f97-8515-e092cb752f85" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-quobyte-cbff0d4c-5305-4d53-b317-cfe34fb141d4" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-cbff0d4c-5305-4d53-b317-cfe34fb141d4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Deleting offline snapshot cbff0d4c-5305-4d53-b317-cfe34fb141d4 of volume b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] snapshot_file for this snap is: volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e821d7-3425-42eb-9ee5-5803f0a2775a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:16 devstack sudo[113186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 Aug 26 03:17:16 devstack sudo[113186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:16 devstack sudo[113186]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4" returned: 0 in 0.373s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b334db9e-e460-4f97-8515-e092cb752f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4706cc7-404c-4585-ace4-33bbb8a4edce]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:16 devstack sudo[113191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 Aug 26 03:17:16 devstack sudo[113191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:17 devstack sudo[113191]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85" returned: 0 in 0.550s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:17 devstack sudo[113197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 Aug 26 03:17:17 devstack sudo[113197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:17 devstack sudo[113197]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4" returned: 0 in 0.381s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:17 devstack sudo[113203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4 Aug 26 03:17:17 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:17 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85.cbff0d4c-5305-4d53-b317-cfe34fb141d4" returned: 0 in 0.264s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-cbff0d4c-5305-4d53-b317-cfe34fb141d4" released by "_delete_snapshot" :: held 1.675s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-b334db9e-e460-4f97-8515-e092cb752f85" released by "delete_snapshot" :: held 1.701s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Created reservations ['2cfe956b-10a5-4084-8a11-ebd181b8694a', '604fcc58-3627-404b-9b6b-91f2cd76c921', '2c732eb0-c826-43cc-9dff-0a51134bb764', '3c274400-ef22-446d-83e9-b1dc68f95c9e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Delete snapshot completed successfully. Aug 26 03:17:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-224929c4-cfcf-42a8-9fd7-f42fb2bcca46 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-cbff0d4c-5305-4d53-b317-cfe34fb141d4-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-b334db9e-e460-4f97-8515-e092cb752f85-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-b334db9e-e460-4f97-8515-e092cb752f85-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-quobyte-b334db9e-e460-4f97-8515-e092cb752f85" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-b334db9e-e460-4f97-8515-e092cb752f85" acquired by "delete_volume" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:18 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[00371141-b797-4412-a597-a684bd99cdff]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:18 devstack sudo[113206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 Aug 26 03:17:18 devstack sudo[113206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:18 devstack sudo[113206]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85" returned: 0 in 0.370s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:18 devstack sudo[113212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85 Aug 26 03:17:18 devstack sudo[113212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:19 devstack sudo[113212]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b334db9e-e460-4f97-8515-e092cb752f85" returned: 0 in 0.248s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-b334db9e-e460-4f97-8515-e092cb752f85" released by "delete_volume" :: held 0.676s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Created reservations ['820f9c17-b7d8-4b86-ae0e-ff1b6c75fc62', '0b283ce4-a68e-4654-ad83-50db00276a57', '07fd5fc1-9caa-457b-8660-c294b4a8f464', 'fbb336cf-9c0a-44e1-b94e-b85b5e6baa73'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:19 devstack sudo[113215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:19 devstack sudo[113215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:19 devstack sudo[113215]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.259s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Deleted volume successfully. Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc211387-ba9e-4dcf-9a6e-bb2c573d0c31 tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-b334db9e-e460-4f97-8515-e092cb752f85-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-7f909e94-8520-416b-9fd7-7eab74d38081-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-7f909e94-8520-416b-9fd7-7eab74d38081-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "cinder-quobyte-7f909e94-8520-416b-9fd7-7eab74d38081" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-7f909e94-8520-416b-9fd7-7eab74d38081" acquired by "delete_volume" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b75da-9401-461e-a509-d8aa83a018ad]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:19 devstack sudo[113218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 Aug 26 03:17:19 devstack sudo[113218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:20 devstack sudo[113218]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081" returned: 0 in 0.429s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:20 devstack sudo[113223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081 Aug 26 03:17:20 devstack sudo[113223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:20 devstack sudo[113223]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-7f909e94-8520-416b-9fd7-7eab74d38081" returned: 0 in 0.284s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-quobyte-7f909e94-8520-416b-9fd7-7eab74d38081" released by "delete_volume" :: held 0.755s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Created reservations ['1aaff896-0a87-4432-a72a-183a9b949ba3', '839a01af-19ca-4507-80df-a3ddd5935a99', 'a86a5b40-2a76-458a-934a-d59603b00ef1', '35a1a8b6-1783-4fee-8dc7-e5caa9c7f4fb'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:20 devstack sudo[113226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:20 devstack sudo[113226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:20 devstack sudo[113226]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.257s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Deleted volume successfully. Aug 26 03:17:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6accb768-c468-434a-895c-8f2362c60edc tempest-SnapshotDependencyTests-600262078 None] Lock "cinder-7f909e94-8520-416b-9fd7-7eab74d38081-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:30 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=28,cinder:SELECT=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:17:30 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=24,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=3 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:17:42 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (f56a58eb-7745-4223-bbde-303eea891458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c07654c-0965-43f4-bdd0-4a387186c997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c07654c-0965-43f4-bdd0-4a387186c997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144008066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe15116-e96a-447f-81eb-95f68f238a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:43Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a53932-6523-425e-8a99-45220e5cbf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a53932-6523-425e-8a99-45220e5cbf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8b4343-c3b8-4072-ba16-efa1aa8136e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8b4343-c3b8-4072-ba16-efa1aa8136e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe15116-e96a-447f-81eb-95f68f238a66', 'volume_name': 'volume-dfe15116-e96a-447f-81eb-95f68f238a66', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73f8fe6-77d0-4a54-8209-5257a6ece17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73f8fe6-77d0-4a54-8209-5257a6ece17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd1677b-6802-4390-95e1-fb3748c46440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume dfe15116-e96a-447f-81eb-95f68f238a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe15116-e96a-447f-81eb-95f68f238a66', 'volume_size': 1} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144008066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe15116-e96a-447f-81eb-95f68f238a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:43Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Creating volume dfe15116-e96a-447f-81eb-95f68f238a66 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:43 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:43 devstack sudo[113275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 1073741824 Aug 26 03:17:43 devstack sudo[113275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (51139ce4-a044-4f1c-bac9-b0a003be7819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6394475-4b69-452f-a619-94fbb6dd1ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6394475-4b69-452f-a619-94fbb6dd1ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623305469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63a3a80-3e4f-4aa8-a343-2ff0571197d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:43Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389c2f63-1235-41f8-a2b2-08fd105366bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389c2f63-1235-41f8-a2b2-08fd105366bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efa6d38-0224-4800-9ca1-5c089f7f3502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efa6d38-0224-4800-9ca1-5c089f7f3502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63a3a80-3e4f-4aa8-a343-2ff0571197d1', 'volume_name': 'volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a999c64-4ff4-4428-b403-9057a3f95af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a999c64-4ff4-4428-b403-9057a3f95af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87ed02f-61a9-4a94-841f-3badf68166cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Volume d63a3a80-3e4f-4aa8-a343-2ff0571197d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1', 'volume_size': 1} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (b3179778-3c98-463c-840b-fda073edf97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc5e35e-1480-4808-b2aa-60b843ffb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc5e35e-1480-4808-b2aa-60b843ffb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507704500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53850598-524e-4bdb-88da-b4aad2853e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:43Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a612f46e-1d60-4235-9177-6582340e4f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a612f46e-1d60-4235-9177-6582340e4f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640e6d1d-75c2-43e4-912b-6b177b961fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640e6d1d-75c2-43e4-912b-6b177b961fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53850598-524e-4bdb-88da-b4aad2853e70', 'volume_name': 'volume-53850598-524e-4bdb-88da-b4aad2853e70', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad9eca5-d7f5-42b8-9a5e-92241644db3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad9eca5-d7f5-42b8-9a5e-92241644db3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80586761-8864-4d38-98e3-997cf90d2dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Volume 53850598-524e-4bdb-88da-b4aad2853e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53850598-524e-4bdb-88da-b4aad2853e70', 'volume_size': 1} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:43 devstack sudo[113275]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 1073741824" returned: 0 in 0.782s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:43 devstack sudo[113281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 Aug 26 03:17:43 devstack sudo[113281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:44 devstack sudo[113281]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66" returned: 0 in 0.381s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623305469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63a3a80-3e4f-4aa8-a343-2ff0571197d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:43Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Creating volume d63a3a80-3e4f-4aa8-a343-2ff0571197d1 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:44 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd1677b-6802-4390-95e1-fb3748c46440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe15116-e96a-447f-81eb-95f68f238a66', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:44 devstack sudo[113284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 1073741824 Aug 26 03:17:44 devstack sudo[113284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b39d22-e2fd-42ae-8279-00e0632c1b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (d904e665-cf2f-42b2-9ae9-d6472b581d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976e6e54-a745-4003-98a7-2270e7321b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:44 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume volume-dfe15116-e96a-447f-81eb-95f68f238a66 (dfe15116-e96a-447f-81eb-95f68f238a66): created successfully Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b39d22-e2fd-42ae-8279-00e0632c1b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (f56a58eb-7745-4223-bbde-303eea891458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976e6e54-a745-4003-98a7-2270e7321b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302639383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47eb2035-2ada-4400-80ae-651f46ed0884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:44Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2298b6-3ef3-4ee4-957c-07de0bd8c4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2298b6-3ef3-4ee4-957c-07de0bd8c4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b14ec7-8b8d-448f-8a5f-de585936e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b14ec7-8b8d-448f-8a5f-de585936e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47eb2035-2ada-4400-80ae-651f46ed0884', 'volume_name': 'volume-47eb2035-2ada-4400-80ae-651f46ed0884', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b53256-a19b-4e05-aaa5-bb78af124bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b53256-a19b-4e05-aaa5-bb78af124bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ed5223-4351-4f4b-aa12-6afdc4477337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:44 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Volume 47eb2035-2ada-4400-80ae-651f46ed0884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47eb2035-2ada-4400-80ae-651f46ed0884', 'volume_size': 1} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:44 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e0cefdd9-356a-43a6-a1c4-2c7209b94578 tempest-CreateVolumesFromSnapshotTest-266541631 None] Created volume successfully. Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (470ef84b-76c3-4076-8a16-530c33802759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021e31bd-c084-4322-8dd2-14ab86fb3723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021e31bd-c084-4322-8dd2-14ab86fb3723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-379018826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76903fb6-260d-4c95-b6cf-61557cb93434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:45Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff15c86-c6c8-4f15-aa15-efdf7bed923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff15c86-c6c8-4f15-aa15-efdf7bed923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44abd5-db1e-4840-bf56-e2af3f551a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44abd5-db1e-4840-bf56-e2af3f551a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76903fb6-260d-4c95-b6cf-61557cb93434', 'volume_name': 'volume-76903fb6-260d-4c95-b6cf-61557cb93434', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf3651e-14ee-4033-b73f-3f817b0a5696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf3651e-14ee-4033-b73f-3f817b0a5696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4627858e-364a-4cee-a7b0-7d1033366fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Volume 76903fb6-260d-4c95-b6cf-61557cb93434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76903fb6-260d-4c95-b6cf-61557cb93434', 'volume_size': 1} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (8020264e-42d5-45ea-9b20-566420747821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7121cd5-98bd-4c93-915d-d58732d17346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7121cd5-98bd-4c93-915d-d58732d17346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-297880742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20500911-4f29-415c-a450-660a3ca1a3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:45Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfc5daf-cde3-4783-ba60-10709c21ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack sudo[113284]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfc5daf-cde3-4783-ba60-10709c21ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beae24a-e641-4bb6-8377-78b2a0209fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beae24a-e641-4bb6-8377-78b2a0209fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20500911-4f29-415c-a450-660a3ca1a3e1', 'volume_name': 'volume-20500911-4f29-415c-a450-660a3ca1a3e1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859dda1b-d047-4c2d-9f48-c9312fde6e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859dda1b-d047-4c2d-9f48-c9312fde6e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ec799c-28a5-4017-9d34-f68c0eb26427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Volume 20500911-4f29-415c-a450-660a3ca1a3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20500911-4f29-415c-a450-660a3ca1a3e1', 'volume_size': 1} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 1073741824" returned: 0 in 0.977s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:45 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:45 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:45 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1" returned: 0 in 0.314s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507704500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53850598-524e-4bdb-88da-b4aad2853e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:43Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Creating volume 53850598-524e-4bdb-88da-b4aad2853e70 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:45 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:45 devstack sudo[113293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 1073741824 Aug 26 03:17:45 devstack sudo[113293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87ed02f-61a9-4a94-841f-3badf68166cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553c48f6-e627-482d-aa60-c8e640a23193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:45 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Volume volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 (d63a3a80-3e4f-4aa8-a343-2ff0571197d1): created successfully Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553c48f6-e627-482d-aa60-c8e640a23193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:45 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (51139ce4-a044-4f1c-bac9-b0a003be7819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:45 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-564a2faa-1090-46b8-b516-ef99d39ed6e0 tempest-CreateVolumesFromImageTest-1526319248 None] Created volume successfully. Aug 26 03:17:46 devstack sudo[113293]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 1073741824" returned: 0 in 0.677s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:46 devstack sudo[113301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 Aug 26 03:17:46 devstack sudo[113301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:46 devstack sudo[113301]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302639383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47eb2035-2ada-4400-80ae-651f46ed0884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:44Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Creating volume 47eb2035-2ada-4400-80ae-651f46ed0884 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:46 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80586761-8864-4d38-98e3-997cf90d2dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53850598-524e-4bdb-88da-b4aad2853e70', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:46 devstack sudo[113304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 1073741824 Aug 26 03:17:46 devstack sudo[113304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab4d08e-4f68-474d-8b83-ae6fd3a1eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:46 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Volume volume-53850598-524e-4bdb-88da-b4aad2853e70 (53850598-524e-4bdb-88da-b4aad2853e70): created successfully Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab4d08e-4f68-474d-8b83-ae6fd3a1eb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (b3179778-3c98-463c-840b-fda073edf97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ec004855-372f-4c8b-8f3b-614023e1728e tempest-CreateVolumesFromImageTest-1526319248 None] Created volume successfully. Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Flow 'volume_create_manager' (ae905880-4345-4370-a356-37654ddccc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9888e391-1ad9-40f7-9f50-2bdd5e63b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9888e391-1ad9-40f7-9f50-2bdd5e63b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b2ce59-6f26-4f6f-91e3-5611c405a3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52ce276b1204bdb9cd5699b24696859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:47Z,use_quota=True,user_id='e5efec09b0274fdf95107fa5b3945846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabb6930-bd11-4168-90ad-34796af4ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabb6930-bd11-4168-90ad-34796af4ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff73437-6326-4701-b9c5-092211a8b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:17:47 devstack sudo[113304]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 1073741824" returned: 0 in 0.581s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:47 devstack sudo[113310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 Aug 26 03:17:47 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff73437-6326-4701-b9c5-092211a8b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84b2ce59-6f26-4f6f-91e3-5611c405a3c1', 'volume_name': 'volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1', 'volume_size': 1, 'image_id': '6e6ceeed-4be9-4811-af88-acee774d8cff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6ceeed-4be9-4811-af88-acee774d8cff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3943cbf4084a74505849276b444043bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a52ce276b1204bdb9cd5699b24696859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '752c18ea7e1088892d36d7bde841053d3cb61e2acc0609a0c9a999cace9f6e79c27c99d3b47940cfc8069308528b040c11cd0c522b50aeef48117b5e4b6cdef0', 'id': '6e6ceeed-4be9-4811-af88-acee774d8cff', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6ceeed-4be9-4811-af88-acee774d8cff/file', 'properties': {}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3ba6ea-1084-4cf9-b713-dafb5b0af8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3ba6ea-1084-4cf9-b713-dafb5b0af8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711e73a7-f129-4c32-8590-27e84b686cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Volume 84b2ce59-6f26-4f6f-91e3-5611c405a3c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1', 'volume_size': 1, 'image_id': '6e6ceeed-4be9-4811-af88-acee774d8cff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6ceeed-4be9-4811-af88-acee774d8cff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3943cbf4084a74505849276b444043bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a52ce276b1204bdb9cd5699b24696859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '752c18ea7e1088892d36d7bde841053d3cb61e2acc0609a0c9a999cace9f6e79c27c99d3b47940cfc8069308528b040c11cd0c522b50aeef48117b5e4b6cdef0', 'id': '6e6ceeed-4be9-4811-af88-acee774d8cff', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6ceeed-4be9-4811-af88-acee774d8cff/file', 'properties': {}}, 'image_service': } Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Trying to clone 84b2ce59-6f26-4f6f-91e3-5611c405a3c1 from image 6e6ceeed-4be9-4811-af88-acee774d8cff at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e6ceeed-4be9-4811-af88-acee774d8cff', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:17:47 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884" returned: 0 in 0.302s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.590s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-379018826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76903fb6-260d-4c95-b6cf-61557cb93434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:45Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Creating volume 76903fb6-260d-4c95-b6cf-61557cb93434 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:47 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:17:47 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Image download 0.00 MB at 0.00 MB/s Aug 26 03:17:47 devstack sudo[113313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 1073741824 Aug 26 03:17:47 devstack sudo[113313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ed5223-4351-4f4b-aa12-6afdc4477337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47eb2035-2ada-4400-80ae-651f46ed0884', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6649d80a-2c75-4906-9c2c-554d17b6b4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Volume volume-47eb2035-2ada-4400-80ae-651f46ed0884 (47eb2035-2ada-4400-80ae-651f46ed0884): created successfully Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6649d80a-2c75-4906-9c2c-554d17b6b4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (d904e665-cf2f-42b2-9ae9-d6472b581d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[7269c807-ac40-4922-bcc3-b8e36be32cfb]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:47 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-20882fa0-3ad2-4f3c-b592-55cd7782e452 tempest-CreateVolumesFromImageTest-1526319248 None] Created volume successfully. Aug 26 03:17:47 devstack sudo[113315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD Aug 26 03:17:47 devstack sudo[113315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:48 devstack sudo[113315]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:48 devstack sudo[113313]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 1073741824" returned: 0 in 0.617s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:48 devstack sudo[113323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD Aug 26 03:17:48 devstack sudo[113323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:48 devstack sudo[113325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 Aug 26 03:17:48 devstack sudo[113325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Flow 'volume_create_manager' (cc20e550-e992-4061-bb4c-5ada2562991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849a6454-a247-49d9-a72c-6b167a071bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849a6454-a247-49d9-a72c-6b167a071bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d203f5f-fa1c-4f85-9beb-08c329800f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87524928f033494b98de2af0ebd6161b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:49Z,use_quota=True,user_id='74d94ad087f74ee88b19979e10baca89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b0a4ed0-ef60-465b-870a-cc07309cb0b5),volume_type_id=3b0a4ed0-ef60-465b-870a-cc07309cb0b5)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dedb582-a8c2-4060-aee2-29411be51f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dedb582-a8c2-4060-aee2-29411be51f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0357f9-fad6-4c18-8339-aca6beef1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.image.glance [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Creating Keystone auth plugin from conf {{(pid=93797) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:17:48 devstack sudo[113323]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD" returned: 1 in 0.453s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Temporary image 6e6ceeed-4be9-4811-af88-acee774d8cff is fetched for user e5efec09b0274fdf95107fa5b3945846. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:17:48 devstack sudo[113325]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434" returned: 0 in 0.308s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.413s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-297880742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20500911-4f29-415c-a450-660a3ca1a3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd57d7ddcbc48249aa228818bde2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:45Z,use_quota=True,user_id='3563ca43f0e34118aa587f5b17caa807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Creating volume 20500911-4f29-415c-a450-660a3ca1a3e1 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:48 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:48 devstack sudo[113331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 1073741824 Aug 26 03:17:48 devstack sudo[113331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4627858e-364a-4cee-a7b0-7d1033366fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76903fb6-260d-4c95-b6cf-61557cb93434', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de45697-9409-4724-a42e-0156ebde7cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:48 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Volume volume-76903fb6-260d-4c95-b6cf-61557cb93434 (76903fb6-260d-4c95-b6cf-61557cb93434): created successfully Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de45697-9409-4724-a42e-0156ebde7cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (470ef84b-76c3-4076-8a16-530c33802759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82a55ef-d0aa-4b7b-9dac-2bc344d0d402]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:48 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c031eb04-bf09-4d84-8f01-b8ce993eb17c tempest-CreateVolumesFromImageTest-1526319248 None] Created volume successfully. Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0357f9-fad6-4c18-8339-aca6beef1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d203f5f-fa1c-4f85-9beb-08c329800f95', 'volume_name': 'volume-1d203f5f-fa1c-4f85-9beb-08c329800f95', 'volume_size': 1, 'image_id': '51721609-27ae-415d-b5f5-487a8e4eaacc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51721609-27ae-415d-b5f5-487a8e4eaacc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f7d33c33d4079199504207bce15acb3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '87524928f033494b98de2af0ebd6161b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4388c2097b2797a713ca4e0a4eb511a1e053d4104e1857a80f4921f92f11c1c91ad127aed21d60ce0aaf7f3031377b06e798c4b67f2412b22fe42cd7b7236efd', 'id': '51721609-27ae-415d-b5f5-487a8e4eaacc', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51721609-27ae-415d-b5f5-487a8e4eaacc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6d7682-3081-4d68-84c2-f780ed8b6fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6d7682-3081-4d68-84c2-f780ed8b6fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d320cc-4a18-4337-854f-98521ed4e849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:48 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Volume 1d203f5f-fa1c-4f85-9beb-08c329800f95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d203f5f-fa1c-4f85-9beb-08c329800f95', 'volume_size': 1, 'image_id': '51721609-27ae-415d-b5f5-487a8e4eaacc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51721609-27ae-415d-b5f5-487a8e4eaacc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f7d33c33d4079199504207bce15acb3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '87524928f033494b98de2af0ebd6161b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4388c2097b2797a713ca4e0a4eb511a1e053d4104e1857a80f4921f92f11c1c91ad127aed21d60ce0aaf7f3031377b06e798c4b67f2412b22fe42cd7b7236efd', 'id': '51721609-27ae-415d-b5f5-487a8e4eaacc', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51721609-27ae-415d-b5f5-487a8e4eaacc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 03:17:48 devstack sudo[113333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD Aug 26 03:17:48 devstack sudo[113333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:48 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Trying to clone 1d203f5f-fa1c-4f85-9beb-08c329800f95 from image 51721609-27ae-415d-b5f5-487a8e4eaacc at location (None, [{'url': 'file:///opt/stack/data/glance/images/51721609-27ae-415d-b5f5-487a8e4eaacc', 'metadata': {}}]). {{(pid=93797) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:17:49 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Image download 0.00 MB at 0.00 MB/s Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d217701-34e6-4524-ac99-3f61831d3325]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:49 devstack sudo[113333]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:49 devstack sudo[113331]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 1073741824" returned: 0 in 0.533s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack sudo[113339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD Aug 26 03:17:49 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:49 devstack sudo[113344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 Aug 26 03:17:49 devstack sudo[113344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:49 devstack sudo[113342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD Aug 26 03:17:49 devstack sudo[113342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:49 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:49 devstack sudo[113344]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1" returned: 0 in 0.321s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.236s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:49 devstack sudo[113342]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD" returned: 1 in 0.416s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Creating offline snapshot 67565b7b-3e5d-4f07-a793-060bf42fc154 of volume dfe15116-e96a-447f-81eb-95f68f238a66 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ec799c-28a5-4017-9d34-f68c0eb26427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20500911-4f29-415c-a450-660a3ca1a3e1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb94800-aecb-4303-9530-ccf9fb813284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e096f4-4aa8-42c6-a23a-6eb25401a033]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:49 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Volume volume-20500911-4f29-415c-a450-660a3ca1a3e1 (20500911-4f29-415c-a450-660a3ca1a3e1): created successfully Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb94800-aecb-4303-9530-ccf9fb813284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Flow 'volume_create_manager' (8020264e-42d5-45ea-9b20-566420747821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:49 devstack sudo[113353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD Aug 26 03:17:49 devstack sudo[113353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-639712f6-1435-4be2-8b81-2cfc67940eb5 tempest-CreateVolumesFromImageTest-1526319248 None] Created volume successfully. Aug 26 03:17:49 devstack sudo[113354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 Aug 26 03:17:49 devstack sudo[113354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:49 devstack sudo[113353]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD" returned: 1 in 0.369s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:49 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Temporary image 51721609-27ae-415d-b5f5-487a8e4eaacc is fetched for user 74d94ad087f74ee88b19979e10baca89. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1085c7-f22f-4cfa-96c7-618a0bf5efc4]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:50 devstack sudo[113354]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66" returned: 0 in 0.424s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:50 devstack sudo[113365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 1G Aug 26 03:17:50 devstack sudo[113365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:50 devstack sudo[113363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD Aug 26 03:17:50 devstack sudo[113363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:50 devstack sudo[113363]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:50 devstack sudo[113373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD Aug 26 03:17:50 devstack sudo[113373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:50 devstack sudo[113365]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 1G" returned: 0 in 0.500s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe15116-e96a-447f-81eb-95f68f238a66 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:50 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe15116-e96a-447f-81eb-95f68f238a66 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 Aug 26 03:17:50 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-20500911-4f29-415c-a450-660a3ca1a3e1-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-20500911-4f29-415c-a450-660a3ca1a3e1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:50 devstack sudo[113373]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-quobyte-20500911-4f29-415c-a450-660a3ca1a3e1" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-20500911-4f29-415c-a450-660a3ca1a3e1" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[451c93ab-b2b1-4cc5-b608-81f900c65566]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:50 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe15116-e96a-447f-81eb-95f68f238a66 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154" returned: 0 in 0.348s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:50 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 is being set with open permissions: ugo+rw Aug 26 03:17:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:50 devstack sudo[113385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 Aug 26 03:17:50 devstack sudo[113385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:51 devstack sudo[113384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 Aug 26 03:17:51 devstack sudo[113384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:51 devstack sudo[113385]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154" returned: 0 in 0.273s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:51 devstack sudo[113391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.info Aug 26 03:17:51 devstack sudo[113391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:51 devstack sudo[113384]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1" returned: 0 in 0.410s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:51 devstack sudo[113394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1 Aug 26 03:17:51 devstack sudo[113394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:51 devstack sudo[113391]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.info" returned: 0 in 0.272s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:51 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.info is being set with open permissions: ugo+rw Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:51 devstack sudo[113397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.info Aug 26 03:17:51 devstack sudo[113397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:51 devstack sudo[113394]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-20500911-4f29-415c-a450-660a3ca1a3e1" returned: 0 in 0.291s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-20500911-4f29-415c-a450-660a3ca1a3e1" released by "delete_volume" :: held 0.755s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Created reservations ['e321ceaf-4da0-442b-8ce0-76d1558e7d50', '44fe17bc-1a38-4a2f-8595-4446b76a088f', '4c5a274c-2fa3-456e-930a-b9b3995aea6b', '3c9ed611-6b8b-4f8a-9634-0ae3691a895a'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:51 devstack sudo[113397]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:51 devstack sudo[113401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.info" returned: 0 in 0.276s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:51 devstack sudo[113401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.194s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b2ce59-6f26-4f6f-91e3-5611c405a3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52ce276b1204bdb9cd5699b24696859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:47Z,use_quota=True,user_id='e5efec09b0274fdf95107fa5b3945846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Creating volume 84b2ce59-6f26-4f6f-91e3-5611c405a3c1 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:51 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:51 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 1073741824 Aug 26 03:17:51 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:51 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-376b1887-3bb4-41cb-91d0-1cd342b7db2e tempest-CreateVolumesFromSnapshotTest-266541631 None] Create snapshot completed successfully Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-76903fb6-260d-4c95-b6cf-61557cb93434-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-76903fb6-260d-4c95-b6cf-61557cb93434-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-quobyte-76903fb6-260d-4c95-b6cf-61557cb93434" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:52 devstack sudo[113401]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.284s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Deleted volume successfully. Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-76903fb6-260d-4c95-b6cf-61557cb93434" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-bde76c7f-0c16-4b3e-9055-42050c8a9af8 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-20500911-4f29-415c-a450-660a3ca1a3e1-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d29c3-756a-4d4e-8519-78f54d6688c9]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:52 devstack sudo[113408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 Aug 26 03:17:52 devstack sudo[113408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:52 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 1073741824" returned: 0 in 0.554s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:52 devstack sudo[113412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 Aug 26 03:17:52 devstack sudo[113412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:52 devstack sudo[113408]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434" returned: 0 in 0.407s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:52 devstack sudo[113417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434 Aug 26 03:17:52 devstack sudo[113417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:52 devstack sudo[113412]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1" returned: 0 in 0.310s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.938s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d203f5f-fa1c-4f85-9beb-08c329800f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87524928f033494b98de2af0ebd6161b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:49Z,use_quota=True,user_id='74d94ad087f74ee88b19979e10baca89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b0a4ed0-ef60-465b-870a-cc07309cb0b5),volume_type_id=3b0a4ed0-ef60-465b-870a-cc07309cb0b5)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Creating volume 1d203f5f-fa1c-4f85-9beb-08c329800f95 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:52 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:52 devstack sudo[113420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 1073741824 Aug 26 03:17:52 devstack sudo[113420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Attempting download of 6e6ceeed-4be9-4811-af88-acee774d8cff ((None, [{'url': 'file:///opt/stack/data/glance/images/6e6ceeed-4be9-4811-af88-acee774d8cff', 'metadata': {}}])) to volume 84b2ce59-6f26-4f6f-91e3-5611c405a3c1. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:17:52 devstack sudo[113417]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-76903fb6-260d-4c95-b6cf-61557cb93434" returned: 0 in 0.358s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fffc89-97f3-4303-93ac-ad2e6c348a81]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6ceeed-4be9-4811-af88-acee774d8cff_vpjvlmpn {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-76903fb6-260d-4c95-b6cf-61557cb93434" released by "delete_volume" :: held 0.835s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Created reservations ['82b9bfc4-ce8a-4b55-bfa0-d749d3a2bc9f', '421525a3-659d-4c9c-8992-582bfb5ce755', 'fed355e0-dc71-4e37-aedb-d71d23887af4', '30f225d0-c75b-4c2a-a322-dd8a3f02738c'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:53 devstack sudo[113423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6ceeed-4be9-4811-af88-acee774d8cff_vpjvlmpn Aug 26 03:17:53 devstack sudo[113423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:53 devstack sudo[113429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:53 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-47eb2035-2ada-4400-80ae-651f46ed0884-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-47eb2035-2ada-4400-80ae-651f46ed0884-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:53 devstack sudo[113420]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:53 devstack sudo[113423]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (f10a36cd-a733-4ec8-858e-c43f9854e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b089578e-145c-44ea-a584-a44a8f0a5d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6ceeed-4be9-4811-af88-acee774d8cff_vpjvlmpn" returned: 0 in 0.611s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 1073741824" returned: 0 in 0.751s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6ceeed-4be9-4811-af88-acee774d8cff_vpjvlmpn {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b089578e-145c-44ea-a584-a44a8f0a5d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-453149566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af970ff3-76e8-4da8-ac08-25f5267c6637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:53Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b6a160-9b68-4625-8d81-94436ebea926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b6a160-9b68-4625-8d81-94436ebea926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a70ffb4-6d78-4e56-9e58-25834b78e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a70ffb4-6d78-4e56-9e58-25834b78e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af970ff3-76e8-4da8-ac08-25f5267c6637', 'volume_name': 'volume-af970ff3-76e8-4da8-ac08-25f5267c6637', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69e1356-a3e7-4ab3-8cfa-dedadf44bed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69e1356-a3e7-4ab3-8cfa-dedadf44bed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de52d8f-71a1-434a-b3cd-ed7625d80828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume af970ff3-76e8-4da8-ac08-25f5267c6637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af970ff3-76e8-4da8-ac08-25f5267c6637', 'volume_size': 1} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-quobyte-47eb2035-2ada-4400-80ae-651f46ed0884" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:53 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.470s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-47eb2035-2ada-4400-80ae-651f46ed0884" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:53 devstack sudo[113433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6ceeed-4be9-4811-af88-acee774d8cff_vpjvlmpn Aug 26 03:17:53 devstack sudo[113433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:53 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Deleted volume successfully. Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ec2879-8af0-48a9-9ae2-a87f6da7fad4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6fcee964-11f3-4f7f-86bf-17c571255a08 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-76903fb6-260d-4c95-b6cf-61557cb93434-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:53 devstack sudo[113436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 Aug 26 03:17:53 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:53 devstack sudo[113437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 Aug 26 03:17:53 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:53 devstack sudo[113433]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6ceeed-4be9-4811-af88-acee774d8cff_vpjvlmpn" returned: 1 in 0.427s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6ceeed-4be9-4811-af88-acee774d8cff_vpjvlmpn' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd870e4-35e1-4e80-a4ee-026f3bd3b6d4]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:54 devstack sudo[113442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD Aug 26 03:17:54 devstack sudo[113442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:54 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:54 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95" returned: 0 in 0.426s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-453149566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af970ff3-76e8-4da8-ac08-25f5267c6637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:53Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Creating volume af970ff3-76e8-4da8-ac08-25f5267c6637 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:54 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884" returned: 0 in 0.562s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:54 devstack sudo[113448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 1073741824 Aug 26 03:17:54 devstack sudo[113448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:54 devstack sudo[113449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884 Aug 26 03:17:54 devstack sudo[113449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (6322e14f-e10a-4200-8777-be29c86ed0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cb16c4-af5c-411e-9796-d5df13422d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Attempting download of 51721609-27ae-415d-b5f5-487a8e4eaacc ((None, [{'url': 'file:///opt/stack/data/glance/images/51721609-27ae-415d-b5f5-487a8e4eaacc', 'metadata': {}}])) to volume 1d203f5f-fa1c-4f85-9beb-08c329800f95. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cb16c4-af5c-411e-9796-d5df13422d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2110834203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:54Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3293e82e-9bf5-4bfc-994c-5d80ebb2d94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3293e82e-9bf5-4bfc-994c-5d80ebb2d94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40776cfe-33ec-45f0-9e7e-83d3d9b89a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40776cfe-33ec-45f0-9e7e-83d3d9b89a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f', 'volume_name': 'volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134b3573-3b1c-4590-a021-7fdd554b8017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134b3573-3b1c-4590-a021-7fdd554b8017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8577c62-0f1b-45f1-bf9e-0303b1bea730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f', 'volume_size': 1} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:54 devstack sudo[113442]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD" returned: 0 in 0.640s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5da74b-5820-428c-9f86-719cb03962e5]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51721609-27ae-415d-b5f5-487a8e4eaacc__j9dcuov {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:54 devstack sudo[113456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD Aug 26 03:17:54 devstack sudo[113456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:54 devstack sudo[113449]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (6eab8dc3-f418-4b10-8065-1d12eb9780f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee607518-0d80-42bb-87a3-935dfbc50e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-47eb2035-2ada-4400-80ae-651f46ed0884" returned: 0 in 0.565s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-47eb2035-2ada-4400-80ae-651f46ed0884" released by "delete_volume" :: held 1.233s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:54 devstack sudo[113457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51721609-27ae-415d-b5f5-487a8e4eaacc__j9dcuov Aug 26 03:17:54 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee607518-0d80-42bb-87a3-935dfbc50e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-669216886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:55Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d00c4a8-7784-4dda-b5cc-87f5dcda4107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d00c4a8-7784-4dda-b5cc-87f5dcda4107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a13e50-8cdf-4612-bb44-970ebbaa315b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a13e50-8cdf-4612-bb44-970ebbaa315b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66', 'volume_name': 'volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7bb9a2-940d-47aa-974f-9b22da6c2095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7bb9a2-940d-47aa-974f-9b22da6c2095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc43b221-4f43-46a8-86ca-f2b2102448fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:54 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume 265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66', 'volume_size': 1} Aug 26 03:17:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Created reservations ['5b042ffc-643a-4e7f-862c-78f91ad2c876', 'f61f44c5-93c7-4a96-85d0-c3988530c645', '1d4a06dc-5fac-4279-98d4-3df886a6684b', '397b7d07-03c3-423c-b6bc-45848f53cb33'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:55 devstack sudo[113448]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 1073741824" returned: 0 in 0.850s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:55 devstack sudo[113456]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:55 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD" returned: 1 in 0.619s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51721609-27ae-415d-b5f5-487a8e4eaacc__j9dcuov" returned: 0 in 0.597s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] 6e6ceeed-4be9-4811-af88-acee774d8cff was raw, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51721609-27ae-415d-b5f5-487a8e4eaacc__j9dcuov {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:55 devstack sudo[113502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 Aug 26 03:17:55 devstack sudo[113502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:55 devstack sudo[113505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:55 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:55 devstack sudo[113506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 Aug 26 03:17:55 devstack sudo[113506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (edc10375-3e16-43d0-814b-bca8764b4e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251476a2-5528-4755-b6e3-7e50e8f9acab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251476a2-5528-4755-b6e3-7e50e8f9acab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-484067533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50534f7-fd48-4004-9eba-6236b13fd7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:55Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:55 devstack sudo[113504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51721609-27ae-415d-b5f5-487a8e4eaacc__j9dcuov Aug 26 03:17:55 devstack sudo[113504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6869c9d2-a985-442f-8f82-9a30b5d4a542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6869c9d2-a985-442f-8f82-9a30b5d4a542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b44ae4-2114-4e6e-8282-aa9c5c400970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b44ae4-2114-4e6e-8282-aa9c5c400970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50534f7-fd48-4004-9eba-6236b13fd7a1', 'volume_name': 'volume-e50534f7-fd48-4004-9eba-6236b13fd7a1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d54ecf5-3023-483c-8f69-70527e4f3cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d54ecf5-3023-483c-8f69-70527e4f3cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d07ee0-b525-48ff-90f9-c915d29f0219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume e50534f7-fd48-4004-9eba-6236b13fd7a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50534f7-fd48-4004-9eba-6236b13fd7a1', 'volume_size': 1} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:55 devstack sudo[113506]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637" returned: 0 in 0.472s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2110834203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:54Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Creating volume a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:55 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:55 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-53850598-524e-4bdb-88da-b4aad2853e70-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:55 devstack sudo[113517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f 1073741824 Aug 26 03:17:55 devstack sudo[113517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de52d8f-71a1-434a-b3cd-ed7625d80828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af970ff3-76e8-4da8-ac08-25f5267c6637', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf38cb7-ca0d-43d6-b2f4-60a16f6f767b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.670s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Deleted volume successfully. Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-53850598-524e-4bdb-88da-b4aad2853e70-delete_volume" acquired by "delete_volume" :: waited 0.172s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:56 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume volume-af970ff3-76e8-4da8-ac08-25f5267c6637 (af970ff3-76e8-4da8-ac08-25f5267c6637): created successfully Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf38cb7-ca0d-43d6-b2f4-60a16f6f767b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack sudo[113502]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:56 devstack sudo[113504]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (f10a36cd-a733-4ec8-858e-c43f9854e512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1" returned: 0 in 0.907s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51721609-27ae-415d-b5f5-487a8e4eaacc__j9dcuov" returned: 1 in 0.885s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51721609-27ae-415d-b5f5-487a8e4eaacc__j9dcuov' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e6ceeed-4be9-4811-af88-acee774d8cff_cc8d_of7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:17:56 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c24c891-cf39-4edd-94b9-c76f2db46441]: (4, 'raw') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:56 devstack sudo[113522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 1G Aug 26 03:17:56 devstack sudo[113522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-30a5c981-ccac-410c-b2ef-38dfd54eac5f tempest-CreateVolumesFromSnapshotTest-266541631 None] Created volume successfully. Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1ee572e2-c7a4-4203-8ed8-1623f6275998 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-47eb2035-2ada-4400-80ae-651f46ed0884-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-quobyte-53850598-524e-4bdb-88da-b4aad2853e70" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (12ba83cb-53f3-4cb0-9aab-3109f634167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba28be3-5e10-42c2-9cb2-25b64e6ef934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-53850598-524e-4bdb-88da-b4aad2853e70" acquired by "delete_volume" :: waited 0.062s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:56 devstack sudo[113523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD Aug 26 03:17:56 devstack sudo[113523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f06177-cc22-4c30-bb60-deed9c7dad37]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba28be3-5e10-42c2-9cb2-25b64e6ef934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2019352419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f294a5a2-9c0e-4b5f-b3e4-bf269cabc353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:56Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a47f6ed-942d-4ca8-a44b-e626eed6dac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a47f6ed-942d-4ca8-a44b-e626eed6dac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4556e878-9bdf-48fd-99f2-857b986bfef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4556e878-9bdf-48fd-99f2-857b986bfef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f294a5a2-9c0e-4b5f-b3e4-bf269cabc353', 'volume_name': 'volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf63031-0536-4dfa-ae60-ead0c33ece82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf63031-0536-4dfa-ae60-ead0c33ece82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce11d8a-adaf-4503-b179-82c84da53a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:56 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume f294a5a2-9c0e-4b5f-b3e4-bf269cabc353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353', 'volume_size': 1} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:56 devstack sudo[113517]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f 1073741824" returned: 0 in 0.684s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack sudo[113530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 Aug 26 03:17:56 devstack sudo[113530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:56 devstack sudo[113522]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 1G" returned: 0 in 0.459s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Downloaded image 6e6ceeed-4be9-4811-af88-acee774d8cff ((None, [{'url': 'file:///opt/stack/data/glance/images/6e6ceeed-4be9-4811-af88-acee774d8cff', 'metadata': {}}])) to volume 84b2ce59-6f26-4f6f-91e3-5611c405a3c1 successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Temporary image 6e6ceeed-4be9-4811-af88-acee774d8cff for user e5efec09b0274fdf95107fa5b3945846 is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Marking volume 84b2ce59-6f26-4f6f-91e3-5611c405a3c1 as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:17:56 devstack sudo[113536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f Aug 26 03:17:56 devstack sudo[113536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Copying metadata from image 6e6ceeed-4be9-4811-af88-acee774d8cff to 84b2ce59-6f26-4f6f-91e3-5611c405a3c1. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Creating volume glance metadata for volume 84b2ce59-6f26-4f6f-91e3-5611c405a3c1 backed by image 6e6ceeed-4be9-4811-af88-acee774d8cff with: {'image_id': '6e6ceeed-4be9-4811-af88-acee774d8cff', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3943cbf4084a74505849276b444043bb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:17:56 devstack sudo[113523]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD" returned: 0 in 0.567s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711e73a7-f129-4c32-8590-27e84b686cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1', 'volume_size': 1, 'image_id': '6e6ceeed-4be9-4811-af88-acee774d8cff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6ceeed-4be9-4811-af88-acee774d8cff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3943cbf4084a74505849276b444043bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a52ce276b1204bdb9cd5699b24696859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '752c18ea7e1088892d36d7bde841053d3cb61e2acc0609a0c9a999cace9f6e79c27c99d3b47940cfc8069308528b040c11cd0c522b50aeef48117b5e4b6cdef0', 'id': '6e6ceeed-4be9-4811-af88-acee774d8cff', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6ceeed-4be9-4811-af88-acee774d8cff/file', 'properties': {}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac6f477-2f4d-4c65-a04f-61125b923492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:56 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Volume volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 (84b2ce59-6f26-4f6f-91e3-5611c405a3c1): created successfully Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac6f477-2f4d-4c65-a04f-61125b923492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Flow 'volume_create_manager' (ae905880-4345-4370-a356-37654ddccc79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d6f0d640-2785-412c-9a64-9e3031ace70b tempest-VolumeImageDependencyTests-1630585471 None] Created volume successfully. Aug 26 03:17:56 devstack sudo[113540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD Aug 26 03:17:56 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:56 devstack sudo[113530]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70" returned: 0 in 0.494s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:56 devstack sudo[113546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70 Aug 26 03:17:56 devstack sudo[113546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:56 devstack sudo[113536]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f" returned: 0 in 0.386s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.023s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-669216886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:55Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Creating volume 265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:57 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:57 devstack sudo[113549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 1073741824 Aug 26 03:17:57 devstack sudo[113549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8577c62-0f1b-45f1-bf9e-0303b1bea730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c5b8bf-6abb-4a98-a58e-9cccc09ec498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:57 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f (a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f): created successfully Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c5b8bf-6abb-4a98-a58e-9cccc09ec498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (6322e14f-e10a-4200-8777-be29c86ed0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:57 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4c764765-7cb6-49b4-8956-6180c8ca1c8e tempest-CreateVolumesFromSnapshotTest-266541631 None] Created volume successfully. Aug 26 03:17:57 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD" returned: 1 in 0.447s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD' failed. Not Retrying. {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] 51721609-27ae-415d-b5f5-487a8e4eaacc was raw, converting to qcow2 {{(pid=93797) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:57 devstack sudo[113546]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-53850598-524e-4bdb-88da-b4aad2853e70" returned: 0 in 0.376s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack sudo[113555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 Aug 26 03:17:57 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-53850598-524e-4bdb-88da-b4aad2853e70" released by "delete_volume" :: held 0.939s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Created reservations ['d928670d-09f7-4696-9e5a-7a0193ceaa66', 'a9d3e351-c54f-4ece-85d9-b8cc7ebc5038', '94c8a18c-ba5a-401f-8e36-b79aa7db1e21', '5b7f8012-e1fb-4dd5-a4a4-8ee760165906'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Acquiring lock "cinder-84b2ce59-6f26-4f6f-91e3-5611c405a3c1-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Lock "cinder-84b2ce59-6f26-4f6f-91e3-5611c405a3c1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Acquiring lock "cinder-quobyte-84b2ce59-6f26-4f6f-91e3-5611c405a3c1" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Lock "cinder-quobyte-84b2ce59-6f26-4f6f-91e3-5611c405a3c1" acquired by "delete_volume" :: waited 0.050s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:57 devstack sudo[113562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:57 devstack sudo[113562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be47c49-b953-4108-b1e7-536d5a6f310a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:57 devstack sudo[113549]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 1073741824" returned: 0 in 0.702s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:57 devstack sudo[113566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 Aug 26 03:17:57 devstack sudo[113566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:57 devstack sudo[113565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 Aug 26 03:17:57 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:57 devstack sudo[113562]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.317s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:57 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Deleted volume successfully. Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95" returned: 0 in 0.715s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_51721609-27ae-415d-b5f5-487a8e4eaacc_xp7kc2i8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:17:57 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 03:17:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-40297b51-ab43-4341-a76e-ee775d7dac07 tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-53850598-524e-4bdb-88da-b4aad2853e70-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:58 devstack sudo[113571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 1G Aug 26 03:17:58 devstack sudo[113571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:58 devstack sudo[113566]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66" returned: 0 in 0.337s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.375s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-484067533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50534f7-fd48-4004-9eba-6236b13fd7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:55Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Creating volume e50534f7-fd48-4004-9eba-6236b13fd7a1 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:58 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc43b221-4f43-46a8-86ca-f2b2102448fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:58 devstack sudo[113577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 1073741824 Aug 26 03:17:58 devstack sudo[113577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a55ca4f-2c09-4fa3-a894-0af78245236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:58 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1" returned: 0 in 0.481s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 (265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66): created successfully Aug 26 03:17:58 devstack sudo[113579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1 Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a55ca4f-2c09-4fa3-a894-0af78245236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:58 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (6eab8dc3-f418-4b10-8065-1d12eb9780f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9b8a33ca-461f-4447-a3ff-d1a1c255cb4f tempest-CreateVolumesFromSnapshotTest-266541631 None] Created volume successfully. Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-d63a3a80-3e4f-4aa8-a343-2ff0571197d1-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-d63a3a80-3e4f-4aa8-a343-2ff0571197d1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:58 devstack sudo[113571]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 1G" returned: 0 in 0.530s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Downloaded image 51721609-27ae-415d-b5f5-487a8e4eaacc ((None, [{'url': 'file:///opt/stack/data/glance/images/51721609-27ae-415d-b5f5-487a8e4eaacc', 'metadata': {}}])) to volume 1d203f5f-fa1c-4f85-9beb-08c329800f95 successfully. {{(pid=93797) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Temporary image 51721609-27ae-415d-b5f5-487a8e4eaacc for user 74d94ad087f74ee88b19979e10baca89 is deleted. {{(pid=93797) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.volume_utils [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Marking volume 1d203f5f-fa1c-4f85-9beb-08c329800f95 as bootable. {{(pid=93797) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "cinder-quobyte-d63a3a80-3e4f-4aa8-a343-2ff0571197d1" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Copying metadata from image 51721609-27ae-415d-b5f5-487a8e4eaacc to 1d203f5f-fa1c-4f85-9beb-08c329800f95. {{(pid=93797) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Creating volume glance metadata for volume 1d203f5f-fa1c-4f85-9beb-08c329800f95 backed by image 51721609-27ae-415d-b5f5-487a8e4eaacc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '51721609-27ae-415d-b5f5-487a8e4eaacc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3f7d33c33d4079199504207bce15acb3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93797) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-d63a3a80-3e4f-4aa8-a343-2ff0571197d1" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:58 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f5e55b-c499-42eb-b24d-d0fdc7152810]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-84b2ce59-6f26-4f6f-91e3-5611c405a3c1" returned: 0 in 0.468s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Lock "cinder-quobyte-84b2ce59-6f26-4f6f-91e3-5611c405a3c1" released by "delete_volume" :: held 1.039s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d320cc-4a18-4337-854f-98521ed4e849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d203f5f-fa1c-4f85-9beb-08c329800f95', 'volume_size': 1, 'image_id': '51721609-27ae-415d-b5f5-487a8e4eaacc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51721609-27ae-415d-b5f5-487a8e4eaacc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f7d33c33d4079199504207bce15acb3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '87524928f033494b98de2af0ebd6161b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4388c2097b2797a713ca4e0a4eb511a1e053d4104e1857a80f4921f92f11c1c91ad127aed21d60ce0aaf7f3031377b06e798c4b67f2412b22fe42cd7b7236efd', 'id': '51721609-27ae-415d-b5f5-487a8e4eaacc', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51721609-27ae-415d-b5f5-487a8e4eaacc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1fcc81-5bc9-4531-ad51-ded862e1ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:58 devstack sudo[113588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 Aug 26 03:17:58 devstack sudo[113588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Created reservations ['b3fed207-bb96-4522-8c9b-b8b41d8ceb95', '163b30d4-8007-48d4-8669-14957842231d', '933828b8-8b9e-4336-b40e-85def1e24c95', '881ed1b1-9dbe-4690-9dbb-750ba761d3f4'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Volume volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 (1d203f5f-fa1c-4f85-9beb-08c329800f95): created successfully Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1fcc81-5bc9-4531-ad51-ded862e1ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:58 devstack sudo[113577]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Flow 'volume_create_manager' (cc20e550-e992-4061-bb4c-5ada2562991f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 1073741824" returned: 0 in 0.743s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-45995ab8-8630-4b93-8729-03cc17ad83d9 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Created volume successfully. Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:58 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 Aug 26 03:17:58 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:58 devstack sudo[113592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:58 devstack sudo[113592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:59 devstack sudo[113588]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1" returned: 0 in 0.504s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:59 devstack sudo[113597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1 Aug 26 03:17:59 devstack sudo[113597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:59 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1" returned: 0 in 0.296s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.710s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2019352419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f294a5a2-9c0e-4b5f-b3e4-bf269cabc353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f13fbfed8c4fa2b8e67a9bad066c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:56Z,use_quota=True,user_id='64c1c89f39d94d9c9d309d356c07fe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Creating volume f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:59 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:59 devstack sudo[113592]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.294s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:59 devstack sudo[113601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 1073741824 Aug 26 03:17:59 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d07ee0-b525-48ff-90f9-c915d29f0219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50534f7-fd48-4004-9eba-6236b13fd7a1', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f499908-5d06-4e8f-a91b-8d4ffe5d3e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Deleted volume successfully. Aug 26 03:17:59 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 (e50534f7-fd48-4004-9eba-6236b13fd7a1): created successfully Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f499908-5d06-4e8f-a91b-8d4ffe5d3e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (edc10375-3e16-43d0-814b-bca8764b4e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7c70b471-1f30-4686-b5b3-4449a60d1ea5 tempest-VolumeImageDependencyTests-1630585471 None] Lock "cinder-84b2ce59-6f26-4f6f-91e3-5611c405a3c1-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:59 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7e8900a3-2ae4-4832-bef6-aae9933089f7 tempest-CreateVolumesFromSnapshotTest-266541631 None] Created volume successfully. Aug 26 03:17:59 devstack sudo[113597]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d63a3a80-3e4f-4aa8-a343-2ff0571197d1" returned: 0 in 0.300s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-quobyte-d63a3a80-3e4f-4aa8-a343-2ff0571197d1" released by "delete_volume" :: held 0.882s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Created reservations ['e3a573df-6e52-4fa9-9828-b0aac1ac7343', 'b75b87a5-b86e-4a8b-baaa-aa4c45def388', 'c24a9946-484b-4422-bcf2-3df9ec52ea86', '9ef2564c-3902-4565-a799-bfcfbb24e582'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Acquiring lock "cinder-1d203f5f-fa1c-4f85-9beb-08c329800f95-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:59 devstack sudo[113607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:17:59 devstack sudo[113607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "cinder-1d203f5f-fa1c-4f85-9beb-08c329800f95-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Acquiring lock "cinder-quobyte-1d203f5f-fa1c-4f85-9beb-08c329800f95" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "cinder-quobyte-1d203f5f-fa1c-4f85-9beb-08c329800f95" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[07416666-f7ad-434b-8f52-9712fba4866f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:59 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 1073741824" returned: 0 in 0.669s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:59 devstack sudo[113611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 Aug 26 03:17:59 devstack sudo[113611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:00 devstack sudo[113618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 Aug 26 03:18:00 devstack sudo[113618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:00 devstack sudo[113607]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.438s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Deleted volume successfully. Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1b1b4550-44ee-42d5-b1fa-a2c975dc58ae tempest-CreateVolumesFromImageTest-1526319248 None] Lock "cinder-d63a3a80-3e4f-4aa8-a343-2ff0571197d1-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:00 devstack sudo[113611]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95" returned: 0 in 0.481s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:00 devstack sudo[113618]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:00 devstack sudo[113625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95 Aug 26 03:18:00 devstack sudo[113625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce11d8a-adaf-4503-b179-82c84da53a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff74abfb-4706-4405-aa58-cef8592fff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:00 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Volume volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 (f294a5a2-9c0e-4b5f-b3e4-bf269cabc353): created successfully Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff74abfb-4706-4405-aa58-cef8592fff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Flow 'volume_create_manager' (12ba83cb-53f3-4cb0-9aab-3109f634167d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-674ab28b-00c0-4531-945e-5d6d1232dc22 tempest-CreateVolumesFromSnapshotTest-266541631 None] Created volume successfully. Aug 26 03:18:00 devstack sudo[113625]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-1d203f5f-fa1c-4f85-9beb-08c329800f95" returned: 0 in 0.314s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "cinder-quobyte-1d203f5f-fa1c-4f85-9beb-08c329800f95" released by "delete_volume" :: held 0.848s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Created reservations ['b2b7420f-a95d-4911-823e-1a1a92d3c632', '7d33ed4b-db81-4043-85ed-887c44f5cb7a', '3580736b-7e26-4123-9a0f-70495dbe6f27', '16ffd6d6-d8d7-49ff-87d2-6ca5d9c01164'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:00 devstack sudo[113628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:00 devstack sudo[113628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:01 devstack sudo[113628]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.411s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:01 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Deleted volume successfully. Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-417eb9dd-f3fd-4750-8c50-4984ffef7e99 tempest-VolumeAndVolumeTypeFromImageTest-282559203 None] Lock "cinder-1d203f5f-fa1c-4f85-9beb-08c329800f95-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-quobyte-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3db7e3-4abe-40dc-b8b2-b7dec3186d32]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:01 devstack sudo[113631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 Aug 26 03:18:01 devstack sudo[113631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:02 devstack sudo[113631]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353" returned: 0 in 0.713s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:02 devstack sudo[113636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353 Aug 26 03:18:02 devstack sudo[113636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:02 devstack sudo[113638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:02 devstack sudo[113638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:02 devstack sudo[113636]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353" returned: 0 in 0.428s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353" released by "delete_volume" :: held 1.227s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Created reservations ['ac0622ce-0788-46b9-a6bf-fbab6b224578', '8c941081-f45f-43be-9fc3-41bf462af6b2', '4a2ea67b-838b-499e-87b2-318046bc7269', 'c4ed86fd-2c3e-481e-9be5-20a749b4b1b5'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:02 devstack sudo[113638]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.478s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:02 devstack sudo[113642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:02 devstack sudo[113642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:03 devstack sudo[113642]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.284s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Deleted volume successfully. Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0b1fc51f-b634-4d72-8837-11f5aa829b2f tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-f294a5a2-9c0e-4b5f-b3e4-bf269cabc353-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-e50534f7-fd48-4004-9eba-6236b13fd7a1-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-e50534f7-fd48-4004-9eba-6236b13fd7a1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-quobyte-e50534f7-fd48-4004-9eba-6236b13fd7a1" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-e50534f7-fd48-4004-9eba-6236b13fd7a1" acquired by "delete_volume" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8b2091-5724-47d2-907d-944e8df9ed22]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:03 devstack sudo[113645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 Aug 26 03:18:03 devstack sudo[113645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:04 devstack sudo[113645]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1" returned: 0 in 0.499s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:04 devstack sudo[113650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1 Aug 26 03:18:04 devstack sudo[113650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:04 devstack sudo[113650]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e50534f7-fd48-4004-9eba-6236b13fd7a1" returned: 0 in 0.317s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-e50534f7-fd48-4004-9eba-6236b13fd7a1" released by "delete_volume" :: held 0.879s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Created reservations ['96ef5fd0-9d79-4cb2-8110-815317c20022', '6b36b183-1518-4ebe-9770-d059e1bbbc34', '77b2a759-39bf-4068-88a0-cc061d514416', '15615168-0e1b-4f0d-9dfa-b6f08e7c43e7'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:04 devstack sudo[113653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:04 devstack sudo[113653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:05 devstack sudo[113653]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.354s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:05 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Deleted volume successfully. Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2dda235a-f116-441d-85a6-265dc1cd8151 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-e50534f7-fd48-4004-9eba-6236b13fd7a1-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Flow 'volume_create_manager' (e162ea40-1a07-4173-b101-8775c76aef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f28f5d-0120-4082-aae3-6bb84c477e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f28f5d-0120-4082-aae3-6bb84c477e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-521711818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8bf947-da16-49ad-9081-99eb6f546152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88cdce564a4a6aa1fa7f62d13a4e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:05Z,use_quota=True,user_id='dc1e7d195c7843859c95655525032664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67a941b-a356-472e-89d0-cd4a147586b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67a941b-a356-472e-89d0-cd4a147586b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b44a729-9dd7-416c-9894-a69e21584f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b44a729-9dd7-416c-9894-a69e21584f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8bf947-da16-49ad-9081-99eb6f546152', 'volume_name': 'volume-4b8bf947-da16-49ad-9081-99eb6f546152', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c1b814-5a67-45c5-b73e-3e292e93ccfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c1b814-5a67-45c5-b73e-3e292e93ccfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c565fe79-910d-443b-8dab-50ae959b5948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:05 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Volume 4b8bf947-da16-49ad-9081-99eb6f546152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8bf947-da16-49ad-9081-99eb6f546152', 'volume_size': 1} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-521711818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8bf947-da16-49ad-9081-99eb6f546152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88cdce564a4a6aa1fa7f62d13a4e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:05Z,use_quota=True,user_id='dc1e7d195c7843859c95655525032664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Creating volume 4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:05 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:05 devstack sudo[113656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 1073741824 Aug 26 03:18:05 devstack sudo[113656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-quobyte-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c8fd0d-8c18-4ae8-8240-91d37fd6d0c0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:06 devstack sudo[113656]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 1073741824" returned: 0 in 0.719s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:06 devstack sudo[113662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 Aug 26 03:18:06 devstack sudo[113662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:06 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 Aug 26 03:18:06 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:06 devstack sudo[113662]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66" returned: 0 in 0.480s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:06 devstack sudo[113671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66 Aug 26 03:18:06 devstack sudo[113671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:06 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152" returned: 0 in 0.387s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c565fe79-910d-443b-8dab-50ae959b5948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8bf947-da16-49ad-9081-99eb6f546152', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2973be-f458-436d-aaf6-ba3f40bbae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:06 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Volume volume-4b8bf947-da16-49ad-9081-99eb6f546152 (4b8bf947-da16-49ad-9081-99eb6f546152): created successfully Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2973be-f458-436d-aaf6-ba3f40bbae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Flow 'volume_create_manager' (e162ea40-1a07-4173-b101-8775c76aef6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c41f7136-b954-47bf-ad50-61841b1a4635 tempest-VolumeDependencyTests-1780336950 None] Created volume successfully. Aug 26 03:18:06 devstack sudo[113671]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66" returned: 0 in 0.363s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66" released by "delete_volume" :: held 0.908s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Created reservations ['dfd32651-e6ab-4bcc-8fda-96caf38d550c', '0e725672-9deb-45be-90f7-3996755bc61e', '8d12a0a0-bb10-4034-9e0d-47244b6ca594', '2542e1dc-2700-4a76-a452-03f23e8ef924'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:07 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:07 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-quobyte-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[23248835-06ce-4939-ba3c-cf1ca4284ed6]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:07 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.390s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:07 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Deleted volume successfully. Aug 26 03:18:07 devstack sudo[113676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f Aug 26 03:18:07 devstack sudo[113676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6ef132b7-195a-414f-a35f-fbc7fbeae7f6 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-265e4ab9-e5f6-4c83-9ac9-5ce41ba08b66-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Creating offline snapshot d75c8786-822d-4e0c-885e-5077acc96533 of volume 4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:07 devstack sudo[113676]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f" returned: 0 in 0.578s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f000e48-c271-49c4-965c-778cd7416fef]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:07 devstack sudo[113682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f Aug 26 03:18:07 devstack sudo[113682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:08 devstack sudo[113683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 Aug 26 03:18:08 devstack sudo[113683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:08 devstack sudo[113682]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f" returned: 0 in 0.322s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f" released by "delete_volume" :: held 0.965s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Created reservations ['4e4fe019-a2fe-40d1-ba5d-042783dc0277', 'c5814f19-78f9-4c7d-b8f2-e6b01bfd6d01', '6fcf80b8-3fa2-4d3c-b8ae-1689cae057e5', '9be2ac07-1721-4472-a373-2e2a11e23213'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:08 devstack sudo[113683]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152" returned: 0 in 0.518s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:08 devstack sudo[113690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 1G Aug 26 03:18:08 devstack sudo[113690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:08 devstack sudo[113692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:08 devstack sudo[113692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-97915a8d-e4e5-4dde-8f31-5e1e637828cb tempest-ProjectAdminTests-1233925360 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.883586883545, 'free_capacity_gb': 1774.883586883545, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93797) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 03:18:08 devstack sudo[113692]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.474s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:08 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:09 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Deleted volume successfully. Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-698235dd-6644-46b7-9dc8-26b8d4733220 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-a25ebaf5-e2dc-4a7f-b027-84f9df6e0e4f-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:09 devstack sudo[113690]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 1G" returned: 0 in 0.610s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b8bf947-da16-49ad-9081-99eb6f546152 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:09 devstack sudo[113698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b8bf947-da16-49ad-9081-99eb6f546152 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 Aug 26 03:18:09 devstack sudo[113698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:09 devstack sudo[113698]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b8bf947-da16-49ad-9081-99eb6f546152 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533" returned: 0 in 0.384s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:09 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 is being set with open permissions: ugo+rw Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:09 devstack sudo[113704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 Aug 26 03:18:09 devstack sudo[113704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-af970ff3-76e8-4da8-ac08-25f5267c6637-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-af970ff3-76e8-4da8-ac08-25f5267c6637-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-quobyte-af970ff3-76e8-4da8-ac08-25f5267c6637" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:09 devstack sudo[113704]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-af970ff3-76e8-4da8-ac08-25f5267c6637" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533" returned: 0 in 0.369s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3551ea3-c682-4ef7-9e78-ab99de3af99d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:09 devstack sudo[113708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.info Aug 26 03:18:09 devstack sudo[113708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:10 devstack sudo[113707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 Aug 26 03:18:10 devstack sudo[113707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:10 devstack sudo[113708]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.info" returned: 0 in 0.347s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:10 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.info is being set with open permissions: ugo+rw Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:10 devstack sudo[113712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.info Aug 26 03:18:10 devstack sudo[113712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:10 devstack sudo[113707]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637" returned: 0 in 0.549s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:10 devstack sudo[113717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637 Aug 26 03:18:10 devstack sudo[113717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:10 devstack sudo[113712]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.info" returned: 0 in 0.427s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:10 devstack sudo[113717]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af970ff3-76e8-4da8-ac08-25f5267c6637" returned: 0 in 0.327s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-10d0962a-155d-4fe9-8f4e-4d2d1f95c277 tempest-VolumeDependencyTests-1780336950 None] Create snapshot completed successfully Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-af970ff3-76e8-4da8-ac08-25f5267c6637" released by "delete_volume" :: held 0.948s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Created reservations ['2e18cc2a-d939-44d3-aec9-ac4e8b3cb539', '88d38e84-db67-4ad3-97fc-4fa40c419e79', '6c9ebc71-82ea-4870-b77a-335ffe878093', '99d81c89-8ebe-4c2b-a0e9-5beb624dcc2e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:10 devstack sudo[113721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:10 devstack sudo[113721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:11 devstack sudo[113721]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.363s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Deleted volume successfully. Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-74ee0183-e5d8-4092-90cb-7134e2b8ae73 tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-af970ff3-76e8-4da8-ac08-25f5267c6637-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Flow 'volume_create_manager' (554ec6e7-a51b-4739-a377-2867ea72a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0efaad-784a-45a7-b447-58bc7e418ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0efaad-784a-45a7-b447-58bc7e418ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1319635771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8dcf504-4ca3-47ce-8f47-e8d366e0ece2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88cdce564a4a6aa1fa7f62d13a4e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d75c8786-822d-4e0c-885e-5077acc96533,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:12Z,use_quota=True,user_id='dc1e7d195c7843859c95655525032664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcff31d3-ccc6-4adb-9261-69fc4f069d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcff31d3-ccc6-4adb-9261-69fc4f069d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc936f-e6a6-42a1-b983-6cb5ba56a8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc936f-e6a6-42a1-b983-6cb5ba56a8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8dcf504-4ca3-47ce-8f47-e8d366e0ece2', 'volume_name': 'volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2', 'volume_size': 1, 'snapshot_id': 'd75c8786-822d-4e0c-885e-5077acc96533'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eef98a6-807c-41ed-90ad-8561cdae04ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:11 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eef98a6-807c-41ed-90ad-8561cdae04ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db98ee06-229c-48a9-936f-a0ed9d40b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:12 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Volume b8dcf504-4ca3-47ce-8f47-e8d366e0ece2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2', 'volume_size': 1, 'snapshot_id': 'd75c8786-822d-4e0c-885e-5077acc96533'} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-67565b7b-3e5d-4f07-a793-060bf42fc154-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-quobyte-d75c8786-822d-4e0c-885e-5077acc96533-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-67565b7b-3e5d-4f07-a793-060bf42fc154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-quobyte-dfe15116-e96a-447f-81eb-95f68f238a66" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-d75c8786-822d-4e0c-885e-5077acc96533-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Creating volume b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 from snapshot d75c8786-822d-4e0c-885e-5077acc96533 {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-quobyte-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] snapshot: d75c8786-822d-4e0c-885e-5077acc96533, volume: b8dcf504-4ca3-47ce-8f47-e8d366e0ece2, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-dfe15116-e96a-447f-81eb-95f68f238a66" acquired by "delete_snapshot" :: waited 0.053s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-quobyte-67565b7b-3e5d-4f07-a793-060bf42fc154" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-67565b7b-3e5d-4f07-a793-060bf42fc154" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Deleting offline snapshot 67565b7b-3e5d-4f07-a793-060bf42fc154 of volume dfe15116-e96a-447f-81eb-95f68f238a66 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] snapshot_file for this snap is: volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d11e2-1bdb-4112-88df-0b7a29938a06]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a89e1ea-7f92-40b2-a3fe-eae6f1c5b491]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:12 devstack sudo[113724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 Aug 26 03:18:12 devstack sudo[113724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:12 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 Aug 26 03:18:12 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:12 devstack sudo[113724]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533" returned: 0 in 0.494s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b8bf947-da16-49ad-9081-99eb6f546152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[760ca730-32f1-4b0a-909d-34161aa5537e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:12 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154" returned: 0 in 0.525s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe15116-e96a-447f-81eb-95f68f238a66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e86c90-bf58-4522-938e-32abe9d4e088]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:12 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 Aug 26 03:18:12 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:12 devstack sudo[113735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 Aug 26 03:18:12 devstack sudo[113735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:13 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152" returned: 0 in 0.515s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:13 devstack sudo[113735]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66" returned: 0 in 0.480s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:13 devstack sudo[113744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 Aug 26 03:18:13 devstack sudo[113744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:13 devstack sudo[113745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 Aug 26 03:18:13 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:13 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154" returned: 0 in 0.526s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:13 devstack sudo[113754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154 Aug 26 03:18:13 devstack sudo[113754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:15 devstack sudo[113754]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66.67565b7b-3e5d-4f07-a793-060bf42fc154" returned: 0 in 1.349s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-67565b7b-3e5d-4f07-a793-060bf42fc154" released by "_delete_snapshot" :: held 3.117s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-dfe15116-e96a-447f-81eb-95f68f238a66" released by "delete_snapshot" :: held 3.199s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:15 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Created reservations ['63f9c98e-3db6-4020-8906-54e8ad137974', '07103d45-aed3-4d8a-927a-01b825d845e9', '16e21292-f2df-468a-bf05-493a39009106', 'c35a8a39-16e6-4c13-89bd-afeb68df3bd3'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Delete snapshot completed successfully. Aug 26 03:18:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-897b0881-3b52-481e-84ce-f7adbaaae55c tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-67565b7b-3e5d-4f07-a793-060bf42fc154-delete_snapshot" released by "delete_snapshot" :: held 3.783s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-dfe15116-e96a-447f-81eb-95f68f238a66-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-dfe15116-e96a-447f-81eb-95f68f238a66-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "cinder-quobyte-dfe15116-e96a-447f-81eb-95f68f238a66" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-dfe15116-e96a-447f-81eb-95f68f238a66" acquired by "delete_volume" :: waited 0.044s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0050a32-e06a-483e-b83c-d4f215129df3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:17 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 Aug 26 03:18:17 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:18 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66" returned: 0 in 1.269s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:18 devstack sudo[113770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66 Aug 26 03:18:18 devstack sudo[113770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:19 devstack sudo[113770]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-dfe15116-e96a-447f-81eb-95f68f238a66" returned: 0 in 0.915s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-quobyte-dfe15116-e96a-447f-81eb-95f68f238a66" released by "delete_volume" :: held 2.401s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Created reservations ['1623ceec-a045-4df3-8411-0d46cd5a9287', '85d1df41-231b-426f-9aba-dbcd6ee108dd', 'd44ce4f1-6a0d-4a16-9d16-05c0ac1cdc81', '7bf12041-9dbd-453a-90fc-17155533fb74'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:19 devstack sudo[113773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:19 devstack sudo[113773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:19 devstack sudo[113744]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" returned: 0 in 6.710s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:18:19 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Converted 1024.00 MB image at 152.58 MB/s Aug 26 03:18:19 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 is being set with open permissions: ugo+rw Aug 26 03:18:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:19 devstack sudo[113776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 Aug 26 03:18:19 devstack sudo[113776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:20 devstack sudo[113773]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.339s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Deleted volume successfully. Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4fe89e7d-55f9-4cc8-a2d9-4fbaf606464b tempest-CreateVolumesFromSnapshotTest-266541631 None] Lock "cinder-dfe15116-e96a-447f-81eb-95f68f238a66-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:20 devstack sudo[113776]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" returned: 0 in 0.288s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" released by "_copy_volume_from_snapshot" :: held 8.165s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-d75c8786-822d-4e0c-885e-5077acc96533-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" released by "_create_volume_from_snapshot" :: held 8.268s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.300s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db98ee06-229c-48a9-936f-a0ed9d40b84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2', 'volume_size': 1, 'snapshot_id': 'd75c8786-822d-4e0c-885e-5077acc96533'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128ab914-1cc1-4cfb-9da2-986d99444574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:20 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Volume volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 (b8dcf504-4ca3-47ce-8f47-e8d366e0ece2): created successfully Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128ab914-1cc1-4cfb-9da2-986d99444574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Flow 'volume_create_manager' (554ec6e7-a51b-4739-a377-2867ea72a99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-487fb92b-a505-4051-8797-8741fcdddc62 tempest-VolumeDependencyTests-1780336950 None] Created volume successfully. Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-d75c8786-822d-4e0c-885e-5077acc96533-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-d75c8786-822d-4e0c-885e-5077acc96533-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-quobyte-4b8bf947-da16-49ad-9081-99eb6f546152" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-4b8bf947-da16-49ad-9081-99eb6f546152" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-quobyte-d75c8786-822d-4e0c-885e-5077acc96533" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-d75c8786-822d-4e0c-885e-5077acc96533" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Deleting offline snapshot d75c8786-822d-4e0c-885e-5077acc96533 of volume 4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] snapshot_file for this snap is: volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98482dd-1134-4286-8248-81cd44d40589]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:21 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 Aug 26 03:18:21 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:21 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533" returned: 0 in 0.584s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b8bf947-da16-49ad-9081-99eb6f546152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a273d122-4660-4ffe-aa3f-065e0ecd9dc9]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:21 devstack sudo[113786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 Aug 26 03:18:21 devstack sudo[113786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack sudo[113786]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152" returned: 0 in 0.692s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 Aug 26 03:18:22 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533" returned: 0 in 0.495s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack sudo[113797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533 Aug 26 03:18:22 devstack sudo[113797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:23 devstack sudo[113797]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152.d75c8786-822d-4e0c-885e-5077acc96533" returned: 0 in 0.371s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-d75c8786-822d-4e0c-885e-5077acc96533" released by "_delete_snapshot" :: held 2.284s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-4b8bf947-da16-49ad-9081-99eb6f546152" released by "delete_snapshot" :: held 2.317s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:23 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Created reservations ['9b5b0092-8c5c-4f80-85c2-23cec241345d', '667fd9f5-50f7-4a01-a73d-39b25e24a349', 'd0bab966-5026-4ab7-bfd8-39cbbe6bdd6c', '422a1046-fbc4-499b-bf28-9f95c32a4072'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:23 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Delete snapshot completed successfully. Aug 26 03:18:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8480f8f4-e6af-4a94-bdab-155e7a8c02d8 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-d75c8786-822d-4e0c-885e-5077acc96533-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-4b8bf947-da16-49ad-9081-99eb6f546152-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-4b8bf947-da16-49ad-9081-99eb6f546152-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-quobyte-4b8bf947-da16-49ad-9081-99eb6f546152" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-4b8bf947-da16-49ad-9081-99eb6f546152" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:24 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb7c93-5de8-44d2-a889-d35c627c9b5f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack sudo[113802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 Aug 26 03:18:24 devstack sudo[113802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152" returned: 0 in 0.549s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack sudo[113802]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[113808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152 Aug 26 03:18:25 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (e89251b7-0ca2-4bf2-8f94-51b9d7ce1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8e8f0a-76be-49fe-b693-f0b9005b5b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8e8f0a-76be-49fe-b693-f0b9005b5b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1457533488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49520068-7ecf-4b06-9651-50c4726d5409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:25Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735f2489-8fea-4e76-85f0-6cc7619b5ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735f2489-8fea-4e76-85f0-6cc7619b5ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0dc685-9315-443d-9af3-ec907f7f6a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0dc685-9315-443d-9af3-ec907f7f6a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49520068-7ecf-4b06-9651-50c4726d5409', 'volume_name': 'volume-49520068-7ecf-4b06-9651-50c4726d5409', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bf3c19-2b56-49b8-8f03-cae4730158f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bf3c19-2b56-49b8-8f03-cae4730158f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe94cd6-aeb8-4f80-aba8-828a5808ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:25 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume 49520068-7ecf-4b06-9651-50c4726d5409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49520068-7ecf-4b06-9651-50c4726d5409', 'volume_size': 1} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1457533488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49520068-7ecf-4b06-9651-50c4726d5409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:25Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Creating volume 49520068-7ecf-4b06-9651-50c4726d5409 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:25 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[113810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 1073741824 Aug 26 03:18:25 devstack sudo[113810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-4b8bf947-da16-49ad-9081-99eb6f546152" returned: 0 in 0.354s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-4b8bf947-da16-49ad-9081-99eb6f546152" released by "delete_volume" :: held 1.047s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Created reservations ['f6dcb040-e692-447e-98c5-1bc4da03cd25', '297e9d06-a0c3-4dfd-93b1-fd5e683c585a', '48eebed5-928f-4d9c-a675-21f42eac78c7', '10941bc4-db7f-4e8e-badd-a115b0505e57'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[113816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:25 devstack sudo[113816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack sudo[113810]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 1073741824" returned: 0 in 0.702s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack sudo[113816]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.333s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Deleted volume successfully. Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6635cb5c-9f16-4fcd-9378-fac7984b1381 tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-4b8bf947-da16-49ad-9081-99eb6f546152-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:26 devstack sudo[113820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 Aug 26 03:18:26 devstack sudo[113820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack sudo[113820]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409" returned: 0 in 0.303s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe94cd6-aeb8-4f80-aba8-828a5808ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49520068-7ecf-4b06-9651-50c4726d5409', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537a26f1-a9f5-4785-afde-2a51f790b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:26 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume volume-49520068-7ecf-4b06-9651-50c4726d5409 (49520068-7ecf-4b06-9651-50c4726d5409): created successfully Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537a26f1-a9f5-4785-afde-2a51f790b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (e89251b7-0ca2-4bf2-8f94-51b9d7ce1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8eb067cb-9cde-41a0-88bb-027f3e6847b1 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created volume successfully. Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "cinder-quobyte-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ae145-19ce-4d5f-b33e-e5a425cd101d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:27 devstack sudo[113824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 Aug 26 03:18:27 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:27 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" returned: 0 in 0.520s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:27 devstack sudo[113829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2 Aug 26 03:18:27 devstack sudo[113829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:27 devstack sudo[113829]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" returned: 0 in 0.456s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-quobyte-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2" released by "delete_volume" :: held 1.054s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (3fc5ca96-5a3f-4e74-a3e8-ca5aeaec139e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54476cec-0976-45d8-bd2b-2a1349cad030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54476cec-0976-45d8-bd2b-2a1349cad030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844932204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaaf5f89-7627-4a37-bfe7-450fa0b092ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:28Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470818e1-980d-437e-98f6-6ffbfd315d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470818e1-980d-437e-98f6-6ffbfd315d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae372a25-fa52-46a3-a56c-fecab6d581e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae372a25-fa52-46a3-a56c-fecab6d581e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaaf5f89-7627-4a37-bfe7-450fa0b092ad', 'volume_name': 'volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae3cabf-0710-422c-a0f0-2099995ee1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae3cabf-0710-422c-a0f0-2099995ee1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84b2e65-e167-491d-a514-a02e8e2e7999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume eaaf5f89-7627-4a37-bfe7-450fa0b092ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad', 'volume_size': 1} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844932204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaaf5f89-7627-4a37-bfe7-450fa0b092ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:28Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Creating volume eaaf5f89-7627-4a37-bfe7-450fa0b092ad {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:28 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Created reservations ['fa3423aa-695a-463a-9228-ea0ad0c6e6f2', 'dee2cff9-3fd4-42b4-b680-72262073eea1', 'bcb4eb5c-4b28-4c5b-b2fa-8474c645bf3d', '7f5d9e90-a1ae-42dd-a8bc-754252ad6aca'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:28 devstack sudo[113832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad 1073741824 Aug 26 03:18:28 devstack sudo[113832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:28 devstack sudo[113834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:28 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (b08b8ac2-27ed-4025-8c56-5f2cb877c690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26a89e3-02ba-4f1c-a737-8a68702098e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26a89e3-02ba-4f1c-a737-8a68702098e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1923929709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6629be2-22df-48a2-9683-10ff9e8ff467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:29Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458d81e6-04ac-4410-8f58-dc4a20551531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458d81e6-04ac-4410-8f58-dc4a20551531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8567e216-8e4b-42f3-8872-7cb38303aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8567e216-8e4b-42f3-8872-7cb38303aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6629be2-22df-48a2-9683-10ff9e8ff467', 'volume_name': 'volume-e6629be2-22df-48a2-9683-10ff9e8ff467', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c8c1b8-ab7d-4da3-9635-4865edcf562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c8c1b8-ab7d-4da3-9635-4865edcf562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f87f26a-6d96-433f-9887-fa6858017697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:28 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume e6629be2-22df-48a2-9683-10ff9e8ff467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6629be2-22df-48a2-9683-10ff9e8ff467', 'volume_size': 1} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:28 devstack sudo[113832]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad 1073741824" returned: 0 in 0.789s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:28 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.586s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Deleted volume successfully. Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8cf3b806-aa8f-4e05-8381-f6a5f11af30d tempest-VolumeDependencyTests-1780336950 None] Lock "cinder-b8dcf504-4ca3-47ce-8f47-e8d366e0ece2-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:29 devstack sudo[113841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad Aug 26 03:18:29 devstack sudo[113841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:29 devstack sudo[113841]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad" returned: 0 in 0.403s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1923929709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6629be2-22df-48a2-9683-10ff9e8ff467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:29Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Creating volume e6629be2-22df-48a2-9683-10ff9e8ff467 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:29 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84b2e65-e167-491d-a514-a02e8e2e7999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:29 devstack sudo[113844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 1073741824 Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a7efa5-b728-46d8-9c06-db4b995859ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:29 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:29 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad (eaaf5f89-7627-4a37-bfe7-450fa0b092ad): created successfully Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a7efa5-b728-46d8-9c06-db4b995859ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (3fc5ca96-5a3f-4e74-a3e8-ca5aeaec139e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-491502b4-1a16-4c16-b763-84cc1f21e325 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created volume successfully. Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (fd5ae0fe-bf1e-4ec1-b746-da795c4540f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738ed140-19a7-4ff3-8bdd-76797ecb1b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738ed140-19a7-4ff3-8bdd-76797ecb1b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050362884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20b345d-0b0e-4327-a96f-ac861c480aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:30Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79736c5-df17-4902-8010-f6571bcb1d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79736c5-df17-4902-8010-f6571bcb1d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb644fe5-3d6c-4f7a-a2f4-36a92fed65b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb644fe5-3d6c-4f7a-a2f4-36a92fed65b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20b345d-0b0e-4327-a96f-ac861c480aea', 'volume_name': 'volume-d20b345d-0b0e-4327-a96f-ac861c480aea', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d1ef80-4287-4758-bdfd-f899895844ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:30 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d1ef80-4287-4758-bdfd-f899895844ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd534d7-3fb9-411a-82b4-c06e0b67b00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume d20b345d-0b0e-4327-a96f-ac861c480aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20b345d-0b0e-4327-a96f-ac861c480aea', 'volume_size': 1} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 1073741824" returned: 0 in 0.653s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:30 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 Aug 26 03:18:30 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:30 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467" returned: 0 in 0.364s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050362884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20b345d-0b0e-4327-a96f-ac861c480aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:30Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Creating volume d20b345d-0b0e-4327-a96f-ac861c480aea {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:30 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f87f26a-6d96-433f-9887-fa6858017697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6629be2-22df-48a2-9683-10ff9e8ff467', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9420a0-c69c-4f1a-85ea-229482f82d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:30 devstack sudo[113854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea 1073741824 Aug 26 03:18:30 devstack sudo[113854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume volume-e6629be2-22df-48a2-9683-10ff9e8ff467 (e6629be2-22df-48a2-9683-10ff9e8ff467): created successfully Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9420a0-c69c-4f1a-85ea-229482f82d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (b08b8ac2-27ed-4025-8c56-5f2cb877c690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:30 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b908e18d-839b-4e6f-b4f8-edc24ffd75d6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created volume successfully. Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (7841344a-ab03-4ab7-b1c0-3da9cdd47f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2e0475-b711-43e9-8c39-69a01c74be8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2e0475-b711-43e9-8c39-69a01c74be8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361640073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376d0496-2d44-4371-9aa7-331298305be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:31Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0753f0-ee49-4041-9ba4-ec282baee567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0753f0-ee49-4041-9ba4-ec282baee567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ea61a8-b41b-47ad-8c08-d26f01819bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ea61a8-b41b-47ad-8c08-d26f01819bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376d0496-2d44-4371-9aa7-331298305be3', 'volume_name': 'volume-376d0496-2d44-4371-9aa7-331298305be3', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c0046b-79a3-4efd-9636-8cb85e6ffa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c0046b-79a3-4efd-9636-8cb85e6ffa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328f686b-6de4-4bd9-88d8-96b61458e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume 376d0496-2d44-4371-9aa7-331298305be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376d0496-2d44-4371-9aa7-331298305be3', 'volume_size': 1} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (14f5699b-71c6-4b64-b256-129c62864672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7b58f3-5d6a-4c4e-a29f-06de196cd59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack sudo[113854]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7b58f3-5d6a-4c4e-a29f-06de196cd59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046139571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8102d558-1853-4664-9a23-6fa9054849d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:31Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f787b9be-ca1a-410f-a533-b8345639def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f787b9be-ca1a-410f-a533-b8345639def8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254738bc-69e3-43b9-91bb-f31076631c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254738bc-69e3-43b9-91bb-f31076631c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8102d558-1853-4664-9a23-6fa9054849d6', 'volume_name': 'volume-8102d558-1853-4664-9a23-6fa9054849d6', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb940ff-402a-45ee-a9b3-aca937d050fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb940ff-402a-45ee-a9b3-aca937d050fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9cad7d-96d5-45b7-8e73-53f61224d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume 8102d558-1853-4664-9a23-6fa9054849d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8102d558-1853-4664-9a23-6fa9054849d6', 'volume_size': 1} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea 1073741824" returned: 0 in 0.948s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:31 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea Aug 26 03:18:31 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:31 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea" returned: 0 in 0.410s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361640073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376d0496-2d44-4371-9aa7-331298305be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:31Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Creating volume 376d0496-2d44-4371-9aa7-331298305be3 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:31 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd534d7-3fb9-411a-82b4-c06e0b67b00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20b345d-0b0e-4327-a96f-ac861c480aea', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:32 devstack sudo[113864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 1073741824 Aug 26 03:18:32 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99102a22-2391-47bb-8763-68bb305170b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:32 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume volume-d20b345d-0b0e-4327-a96f-ac861c480aea (d20b345d-0b0e-4327-a96f-ac861c480aea): created successfully Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99102a22-2391-47bb-8763-68bb305170b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (fd5ae0fe-bf1e-4ec1-b746-da795c4540f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-08a9f6f6-4d16-41cc-8c37-716b7a100ce7 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created volume successfully. Aug 26 03:18:32 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 1073741824" returned: 0 in 0.734s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:32 devstack sudo[113870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 Aug 26 03:18:32 devstack sudo[113870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Flow 'volume_create_manager' (9ba625ce-2791-400c-82c3-85c45fd4a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08bd25c-38dd-461a-9fe7-28ad9b6476f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08bd25c-38dd-461a-9fe7-28ad9b6476f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879662812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c67820b-6bfe-40e6-af9d-eaabe855d4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15401846cda640df8a8fe6ee77c2096e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:33Z,use_quota=True,user_id='d64b098796dd47be9aea29d0bcbf63c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9b4a52-89e6-4588-bbbb-df5ea4e46d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9b4a52-89e6-4588-bbbb-df5ea4e46d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8588e5e9-6fec-423a-ad91-cd9f579f58d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8588e5e9-6fec-423a-ad91-cd9f579f58d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c67820b-6bfe-40e6-af9d-eaabe855d4e6', 'volume_name': 'volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adae86c-055b-4043-8583-8396e38d627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adae86c-055b-4043-8583-8396e38d627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b0f5e0-fdfd-40a5-8982-1b00bf18a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:32 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Volume 3c67820b-6bfe-40e6-af9d-eaabe855d4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6', 'volume_size': 1} Aug 26 03:18:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:33 devstack sudo[113870]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3" returned: 0 in 0.307s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046139571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8102d558-1853-4664-9a23-6fa9054849d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533c5f31c824968a52e2a4e19dcdad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:31Z,use_quota=True,user_id='68a0b9422665440dadbc094bfc6b79a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Creating volume 8102d558-1853-4664-9a23-6fa9054849d6 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:33 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328f686b-6de4-4bd9-88d8-96b61458e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376d0496-2d44-4371-9aa7-331298305be3', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aeac830-98f6-4065-989b-a372244565f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:33 devstack sudo[113873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 1073741824 Aug 26 03:18:33 devstack sudo[113873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:33 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume volume-376d0496-2d44-4371-9aa7-331298305be3 (376d0496-2d44-4371-9aa7-331298305be3): created successfully Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aeac830-98f6-4065-989b-a372244565f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (7841344a-ab03-4ab7-b1c0-3da9cdd47f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:33 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d5c422f9-d5a0-4f83-b7e2-f829900a21bc tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created volume successfully. Aug 26 03:18:33 devstack sudo[113873]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 1073741824" returned: 0 in 0.520s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:33 devstack sudo[113879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 Aug 26 03:18:33 devstack sudo[113879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:33 devstack sudo[113879]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6" returned: 0 in 0.336s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879662812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c67820b-6bfe-40e6-af9d-eaabe855d4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15401846cda640df8a8fe6ee77c2096e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:33Z,use_quota=True,user_id='d64b098796dd47be9aea29d0bcbf63c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Creating volume 3c67820b-6bfe-40e6-af9d-eaabe855d4e6 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:33 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9cad7d-96d5-45b7-8e73-53f61224d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8102d558-1853-4664-9a23-6fa9054849d6', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack sudo[113882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 1073741824 Aug 26 03:18:34 devstack sudo[113882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75af2ea-d17d-4672-8fe8-5902dc26535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Volume volume-8102d558-1853-4664-9a23-6fa9054849d6 (8102d558-1853-4664-9a23-6fa9054849d6): created successfully Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75af2ea-d17d-4672-8fe8-5902dc26535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Flow 'volume_create_manager' (14f5699b-71c6-4b64-b256-129c62864672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:34 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-df296202-36f7-4f89-91b5-685c704c65ed tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created volume successfully. Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Flow 'volume_create_manager' (2ee528eb-ee99-4466-b0f4-5541358ca696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2426b1de-48b9-4f57-8a0a-5f55456b2710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2426b1de-48b9-4f57-8a0a-5f55456b2710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3944686c-c0b1-4a56-8f6f-35629698f231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9831c7183c4eaca28d19ea0edf4d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:34Z,use_quota=True,user_id='01ff493afabc449ea20fff1dd1c3e839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0935070-7791-46df-ab8c-e1ccf7e810fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0935070-7791-46df-ab8c-e1ccf7e810fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a09c84-b014-4795-948a-268759550140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a09c84-b014-4795-948a-268759550140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3944686c-c0b1-4a56-8f6f-35629698f231', 'volume_name': 'volume-3944686c-c0b1-4a56-8f6f-35629698f231', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d10cd4-687c-41b0-88fa-8821c5d81416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d10cd4-687c-41b0-88fa-8821c5d81416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7435bc-2ba3-49ef-a0de-7957a89756f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Volume 3944686c-c0b1-4a56-8f6f-35629698f231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3944686c-c0b1-4a56-8f6f-35629698f231', 'volume_size': 1} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:34 devstack sudo[113882]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 1073741824" returned: 0 in 0.571s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:34 devstack sudo[113888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 Aug 26 03:18:34 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:34 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6" returned: 0 in 0.300s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3944686c-c0b1-4a56-8f6f-35629698f231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9831c7183c4eaca28d19ea0edf4d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:34Z,use_quota=True,user_id='01ff493afabc449ea20fff1dd1c3e839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Creating volume 3944686c-c0b1-4a56-8f6f-35629698f231 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:34 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b0f5e0-fdfd-40a5-8982-1b00bf18a950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68a04b8-d9b8-45eb-ab96-e8d6ed467499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack sudo[113891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 1073741824 Aug 26 03:18:34 devstack sudo[113891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Volume volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 (3c67820b-6bfe-40e6-af9d-eaabe855d4e6): created successfully Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68a04b8-d9b8-45eb-ab96-e8d6ed467499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Flow 'volume_create_manager' (9ba625ce-2791-400c-82c3-85c45fd4a371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:35 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ebd6f74e-e6ba-4381-8030-98cd23947238 tempest-ProjectReaderTests-1336687382 None] Created volume successfully. Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-8102d558-1853-4664-9a23-6fa9054849d6-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-8102d558-1853-4664-9a23-6fa9054849d6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-quobyte-8102d558-1853-4664-9a23-6fa9054849d6" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-8102d558-1853-4664-9a23-6fa9054849d6" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af6e42-78ba-4640-9479-ec6e72a285be]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:35 devstack sudo[113893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 Aug 26 03:18:35 devstack sudo[113893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:35 devstack sudo[113891]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 1073741824" returned: 0 in 0.594s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:35 devstack sudo[113902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 Aug 26 03:18:35 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:35 devstack sudo[113893]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6" returned: 0 in 0.495s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:35 devstack sudo[113904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6 Aug 26 03:18:35 devstack sudo[113904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:35 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231" returned: 0 in 0.340s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7435bc-2ba3-49ef-a0de-7957a89756f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3944686c-c0b1-4a56-8f6f-35629698f231', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806791d7-ac60-442d-aa1d-e58476b78251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:35 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Volume volume-3944686c-c0b1-4a56-8f6f-35629698f231 (3944686c-c0b1-4a56-8f6f-35629698f231): created successfully Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806791d7-ac60-442d-aa1d-e58476b78251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:35 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Flow 'volume_create_manager' (2ee528eb-ee99-4466-b0f4-5541358ca696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-37087f84-f9e4-4559-9e6d-4f8b00078436 tempest-CinderUnicodeTest-2061850525 None] Created volume successfully. Aug 26 03:18:36 devstack sudo[113904]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8102d558-1853-4664-9a23-6fa9054849d6" returned: 0 in 0.351s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-8102d558-1853-4664-9a23-6fa9054849d6" released by "delete_volume" :: held 0.907s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "cinder-3c67820b-6bfe-40e6-af9d-eaabe855d4e6-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created reservations ['71f44c96-408a-44c6-b791-0fdf65229a56', '4a78b918-f0a8-4fa3-9a05-668b61deeee9', 'c02deb1b-f729-4ed2-b18f-cb06f370efb3', 'b7301d94-46da-46ef-b1c9-16994cd6a5b8'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-3c67820b-6bfe-40e6-af9d-eaabe855d4e6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "cinder-quobyte-3c67820b-6bfe-40e6-af9d-eaabe855d4e6" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-quobyte-3c67820b-6bfe-40e6-af9d-eaabe855d4e6" acquired by "delete_volume" :: waited 0.039s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1727c298-cf88-48cf-931c-69fd8d12a04c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:36 devstack sudo[113910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:36 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:36 devstack sudo[113909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 Aug 26 03:18:36 devstack sudo[113909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:36 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.386s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Deleted volume successfully. Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7bc5f0fc-da59-43f1-8c6b-2b4d2a2165c6 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-8102d558-1853-4664-9a23-6fa9054849d6-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:36 devstack sudo[113909]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6" returned: 0 in 0.530s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:36 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6 Aug 26 03:18:36 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Flow 'volume_create_manager' (266bc13b-f4f8-4e76-95aa-0eaf98a4cc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606f377a-28b9-4d33-aad9-1939a3709743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606f377a-28b9-4d33-aad9-1939a3709743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-396306074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d431c6-3ea1-44ec-8195-dd32f40c78ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9831c7183c4eaca28d19ea0edf4d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:37Z,use_quota=True,user_id='01ff493afabc449ea20fff1dd1c3e839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cbcf3f-9f00-4795-9d76-68515589803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cbcf3f-9f00-4795-9d76-68515589803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae07ae9-bb7a-4dad-82fe-7b9e939803d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae07ae9-bb7a-4dad-82fe-7b9e939803d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d431c6-3ea1-44ec-8195-dd32f40c78ba', 'volume_name': 'volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c64274-0659-4bf7-a290-75fb3607494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c64274-0659-4bf7-a290-75fb3607494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38a0e5f-1aa4-439b-abb0-8c413be76926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:37 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Volume 17d431c6-3ea1-44ec-8195-dd32f40c78ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba', 'volume_size': 1} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-396306074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d431c6-3ea1-44ec-8195-dd32f40c78ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9831c7183c4eaca28d19ea0edf4d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:37Z,use_quota=True,user_id='01ff493afabc449ea20fff1dd1c3e839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Creating volume 17d431c6-3ea1-44ec-8195-dd32f40c78ba {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:37 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:37 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3c67820b-6bfe-40e6-af9d-eaabe855d4e6" returned: 0 in 0.323s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-quobyte-3c67820b-6bfe-40e6-af9d-eaabe855d4e6" released by "delete_volume" :: held 0.922s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:37 devstack sudo[113920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba 1073741824 Aug 26 03:18:37 devstack sudo[113920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Created reservations ['6c3360f6-cf38-4d0b-b217-9e2209801255', '1b2b7b70-0567-4a1f-bf82-164794f172a1', 'aa1cb74c-d583-4a12-b2a6-671fe71186f4', '6fa77b02-e7a9-429a-9113-a494899b2985'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:37 devstack sudo[113922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:37 devstack sudo[113922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-376d0496-2d44-4371-9aa7-331298305be3-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-376d0496-2d44-4371-9aa7-331298305be3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-quobyte-376d0496-2d44-4371-9aa7-331298305be3" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-376d0496-2d44-4371-9aa7-331298305be3" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59f6bcb-ef23-4f45-abd5-d1bd023a5961]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:37 devstack sudo[113926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 Aug 26 03:18:37 devstack sudo[113926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:38 devstack sudo[113922]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.629s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:38 devstack sudo[113920]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba 1073741824" returned: 0 in 0.831s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:38 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Deleted volume successfully. Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8b4322ae-b1cb-47d6-a2a1-e8b1da0dd1c2 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-3c67820b-6bfe-40e6-af9d-eaabe855d4e6-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:38 devstack sudo[113932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba Aug 26 03:18:38 devstack sudo[113932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:38 devstack sudo[113926]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Flow 'volume_create_manager' (57379533-50fd-40ea-859b-937269cec217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e94c22-a060-4a33-b76c-9cdef1824c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3" returned: 0 in 0.684s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e94c22-a060-4a33-b76c-9cdef1824c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424813607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90b4770-a064-4119-82ae-946e1bb43512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15401846cda640df8a8fe6ee77c2096e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:38Z,use_quota=True,user_id='d64b098796dd47be9aea29d0bcbf63c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:38 devstack sudo[113936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3 Aug 26 03:18:38 devstack sudo[113936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1953083f-3c28-43b0-92f2-473c334cbc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1953083f-3c28-43b0-92f2-473c334cbc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8cad4a7-d429-4575-a2fd-7e24e38ce67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8cad4a7-d429-4575-a2fd-7e24e38ce67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90b4770-a064-4119-82ae-946e1bb43512', 'volume_name': 'volume-d90b4770-a064-4119-82ae-946e1bb43512', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4efb940-2a5e-4c06-b6b9-3469164b9357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4efb940-2a5e-4c06-b6b9-3469164b9357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33c7aec-3e80-4ede-899f-c5ee33a59398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:38 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Volume d90b4770-a064-4119-82ae-946e1bb43512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90b4770-a064-4119-82ae-946e1bb43512', 'volume_size': 1} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:38 devstack sudo[113932]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba" returned: 0 in 0.328s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.047s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424813607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90b4770-a064-4119-82ae-946e1bb43512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15401846cda640df8a8fe6ee77c2096e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:38Z,use_quota=True,user_id='d64b098796dd47be9aea29d0bcbf63c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Creating volume d90b4770-a064-4119-82ae-946e1bb43512 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:38 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:38 devstack sudo[113939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 1073741824 Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38a0e5f-1aa4-439b-abb0-8c413be76926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:38 devstack sudo[113939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ffb60b-69a7-4834-b02d-b7be922ff5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:38 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Volume volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba (17d431c6-3ea1-44ec-8195-dd32f40c78ba): created successfully Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ffb60b-69a7-4834-b02d-b7be922ff5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Flow 'volume_create_manager' (266bc13b-f4f8-4e76-95aa-0eaf98a4cc14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:38 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f0a3cf28-3e27-4231-9fe8-d50cc21e6ee8 tempest-CinderUnicodeTest-2061850525 None] Created volume successfully. Aug 26 03:18:38 devstack sudo[113936]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-376d0496-2d44-4371-9aa7-331298305be3" returned: 0 in 0.348s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-376d0496-2d44-4371-9aa7-331298305be3" released by "delete_volume" :: held 1.111s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created reservations ['e9accc4c-cfb6-4d37-abcb-0f20a89b7312', '3e9a559a-ccb9-4df3-953d-5e502f001d01', 'f2c58d85-ac31-4798-b7a9-8ab440e5418c', '916d50e6-1c37-47e9-b430-49917f58432b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:38 devstack sudo[113947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:38 devstack sudo[113947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:39 devstack sudo[113939]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 1073741824" returned: 0 in 0.631s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:39 devstack sudo[113950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 Aug 26 03:18:39 devstack sudo[113950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:39 devstack sudo[113947]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.363s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:39 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Deleted volume successfully. Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3c9601f6-1482-4d8b-8c23-273560932410 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-376d0496-2d44-4371-9aa7-331298305be3-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:39 devstack sudo[113950]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512" returned: 0 in 0.343s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33c7aec-3e80-4ede-899f-c5ee33a59398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90b4770-a064-4119-82ae-946e1bb43512', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf3cd9a-1209-41ce-98fc-aa0ca1babe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:39 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Volume volume-d90b4770-a064-4119-82ae-946e1bb43512 (d90b4770-a064-4119-82ae-946e1bb43512): created successfully Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf3cd9a-1209-41ce-98fc-aa0ca1babe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Flow 'volume_create_manager' (57379533-50fd-40ea-859b-937269cec217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Creating offline snapshot de8c0471-4f07-4e59-b3b0-a7df0dc2f941 of volume 17d431c6-3ea1-44ec-8195-dd32f40c78ba {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:39 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b1c1e9e4-0a14-41ca-a72d-1fcf10a4185a tempest-ProjectReaderTests-1336687382 None] Created volume successfully. Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fe0a37-e087-460f-9060-579f3716a438]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:39 devstack sudo[113953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba Aug 26 03:18:39 devstack sudo[113953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-d20b345d-0b0e-4327-a96f-ac861c480aea-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-d20b345d-0b0e-4327-a96f-ac861c480aea-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:39 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Flow 'volume_create_manager' (6b78492b-d3d7-4a7e-b1a0-f73a7192c015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a9b5e9-d7a0-4651-9a59-872943c54896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-quobyte-d20b345d-0b0e-4327-a96f-ac861c480aea" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a9b5e9-d7a0-4651-9a59-872943c54896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650204345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50337156-2b00-4dfd-9f04-e5d2aa7dfead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f067a83e0edc4db5bfc3e649f7ab5897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:40Z,use_quota=True,user_id='bdc1b95abfa0443ea8afbc783544314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca8883a-89e4-4440-b6a5-afa1e4c82bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca8883a-89e4-4440-b6a5-afa1e4c82bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c228f434-4444-4630-8993-1fad6af39e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack sudo[113953]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c228f434-4444-4630-8993-1fad6af39e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50337156-2b00-4dfd-9f04-e5d2aa7dfead', 'volume_name': 'volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b57e95-a648-4ed0-8717-c45428f89826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b57e95-a648-4ed0-8717-c45428f89826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bc47bb-8626-4d33-9fef-e04da7163eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Volume 50337156-2b00-4dfd-9f04-e5d2aa7dfead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead', 'volume_size': 1} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-d20b345d-0b0e-4327-a96f-ac861c480aea" acquired by "delete_volume" :: waited 0.069s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba" returned: 0 in 0.497s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc153393-27bf-4a47-b501-0d7daad3c165]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:40 devstack sudo[113958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 1G Aug 26 03:18:40 devstack sudo[113958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:40 devstack sudo[113959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea Aug 26 03:18:40 devstack sudo[113959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "cinder-d90b4770-a064-4119-82ae-946e1bb43512-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-d90b4770-a064-4119-82ae-946e1bb43512-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "cinder-quobyte-d90b4770-a064-4119-82ae-946e1bb43512" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-quobyte-d90b4770-a064-4119-82ae-946e1bb43512" acquired by "delete_volume" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a43a2a-5320-4f9c-b678-2d1c5058ff79]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:40 devstack sudo[113959]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea" returned: 0 in 0.501s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:40 devstack sudo[113958]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 1G" returned: 0 in 0.539s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:40 devstack sudo[113971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea Aug 26 03:18:40 devstack sudo[113971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:40 devstack sudo[113972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 Aug 26 03:18:40 devstack sudo[113972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:40 devstack sudo[113970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 Aug 26 03:18:40 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack sudo[113971]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d20b345d-0b0e-4327-a96f-ac861c480aea" returned: 0 in 0.371s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-d20b345d-0b0e-4327-a96f-ac861c480aea" released by "delete_volume" :: held 0.924s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=176,cinder:UPDATE=232,cinder:INSERT=64,cinder:DELETE=17 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:18:41 devstack sudo[113972]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:UPDATE=244,cinder:SELECT=176,cinder:DELETE=28,cinder:INSERT=62 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941" returned: 0 in 0.390s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 is being set with open permissions: ugo+rw Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[113983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 Aug 26 03:18:41 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512" returned: 0 in 0.510s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[113985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512 Aug 26 03:18:41 devstack sudo[113985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created reservations ['1e903e37-6426-447e-9a46-fe74d0a8b92f', '45a94f63-ab29-413f-9241-a1c8cbfc5943', '5f37b4a6-7e62-4ac1-9a8d-ff189521a377', '8ed6d49f-332b-4133-8b3d-b51473262b28'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[113987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:41 devstack sudo[113987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941" returned: 0 in 0.305s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[113985]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d90b4770-a064-4119-82ae-946e1bb43512" returned: 0 in 0.315s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack sudo[113991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.info Aug 26 03:18:41 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-quobyte-d90b4770-a064-4119-82ae-946e1bb43512" released by "delete_volume" :: held 0.877s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Created reservations ['850b9038-ab51-45e2-a592-55d5ca6c64f9', 'c5a02be0-96d8-4ab6-87a4-8f7c9a538b13', 'd952598f-b783-42a0-92fc-4ff96d6cb330', 'e2765207-046e-459c-b5b1-907d776027a1'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:41 devstack sudo[113987]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.301s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:41 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Deleted volume successfully. Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a906c50-2213-477b-8a78-9e332089003c tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-d20b345d-0b0e-4327-a96f-ac861c480aea-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[113994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:41 devstack sudo[113994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.info" returned: 0 in 0.373s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.info is being set with open permissions: ugo+rw Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[113999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.info Aug 26 03:18:41 devstack sudo[113999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack sudo[113994]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.305s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Deleted volume successfully. Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-3fb21b43-5f18-4c8a-9930-85642bc73f89 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-d90b4770-a064-4119-82ae-946e1bb43512-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:42 devstack sudo[113999]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.info" returned: 0 in 0.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650204345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50337156-2b00-4dfd-9f04-e5d2aa7dfead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f067a83e0edc4db5bfc3e649f7ab5897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:40Z,use_quota=True,user_id='bdc1b95abfa0443ea8afbc783544314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Creating volume 50337156-2b00-4dfd-9f04-e5d2aa7dfead {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:42 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:42 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead 1073741824 Aug 26 03:18:42 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-e6629be2-22df-48a2-9683-10ff9e8ff467-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-e6629be2-22df-48a2-9683-10ff9e8ff467-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-abfbddcf-372f-44f0-bad2-f9211b29efdb tempest-CinderUnicodeTest-2061850525 None] Create snapshot completed successfully Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-quobyte-e6629be2-22df-48a2-9683-10ff9e8ff467" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-e6629be2-22df-48a2-9683-10ff9e8ff467" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Flow 'volume_create_manager' (3337fa80-c2d5-483a-94de-20446512e8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f078bb-2913-4a63-a0ae-15b97ead8555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb62bd4-9644-4a13-8a5e-1c26ac00a672]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f078bb-2913-4a63-a0ae-15b97ead8555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915990597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530f20f6-7ab1-4cc0-9504-ac7355c2de89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15401846cda640df8a8fe6ee77c2096e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:42Z,use_quota=True,user_id='d64b098796dd47be9aea29d0bcbf63c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83025508-7cba-4835-ad95-7910d40ca174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83025508-7cba-4835-ad95-7910d40ca174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c755a2-ea39-44e1-adfa-fd7c362de344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c755a2-ea39-44e1-adfa-fd7c362de344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530f20f6-7ab1-4cc0-9504-ac7355c2de89', 'volume_name': 'volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13c0008-3bd5-47c4-ae62-4bf6f873ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13c0008-3bd5-47c4-ae62-4bf6f873ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e117b1-5337-4f05-8eb8-88b9d0791a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:42 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Volume 530f20f6-7ab1-4cc0-9504-ac7355c2de89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89', 'volume_size': 1} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:42 devstack sudo[114005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 Aug 26 03:18:42 devstack sudo[114005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:42 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead 1073741824" returned: 0 in 0.536s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:42 devstack sudo[114013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead Aug 26 03:18:42 devstack sudo[114013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "cinder-de8c0471-4f07-4e59-b3b0-a7df0dc2f941-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:42 devstack sudo[114005]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467" returned: 0 in 0.439s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-de8c0471-4f07-4e59-b3b0-a7df0dc2f941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "cinder-quobyte-17d431c6-3ea1-44ec-8195-dd32f40c78ba" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:42 devstack sudo[114016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467 Aug 26 03:18:42 devstack sudo[114016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-quobyte-17d431c6-3ea1-44ec-8195-dd32f40c78ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "cinder-quobyte-de8c0471-4f07-4e59-b3b0-a7df0dc2f941" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-quobyte-de8c0471-4f07-4e59-b3b0-a7df0dc2f941" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Deleting offline snapshot de8c0471-4f07-4e59-b3b0-a7df0dc2f941 of volume 17d431c6-3ea1-44ec-8195-dd32f40c78ba {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] snapshot_file for this snap is: volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a806e63-71cc-410e-ade4-f84c6a92e37a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114013]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack sudo[114018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 Aug 26 03:18:43 devstack sudo[114018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead" returned: 0 in 0.328s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915990597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530f20f6-7ab1-4cc0-9504-ac7355c2de89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15401846cda640df8a8fe6ee77c2096e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:42Z,use_quota=True,user_id='d64b098796dd47be9aea29d0bcbf63c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Creating volume 530f20f6-7ab1-4cc0-9504-ac7355c2de89 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:43 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114016]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bc47bb-8626-4d33-9fef-e04da7163eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:43 devstack sudo[114022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 1073741824 Aug 26 03:18:43 devstack sudo[114022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ae996a-6dae-4fe0-b97c-45aa4ca36f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e6629be2-22df-48a2-9683-10ff9e8ff467" returned: 0 in 0.316s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-e6629be2-22df-48a2-9683-10ff9e8ff467" released by "delete_volume" :: held 0.841s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:43 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Volume volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead (50337156-2b00-4dfd-9f04-e5d2aa7dfead): created successfully Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ae996a-6dae-4fe0-b97c-45aa4ca36f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Flow 'volume_create_manager' (6b78492b-d3d7-4a7e-b1a0-f73a7192c015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:43 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1d95620f-c162-45b8-bbc6-c1e880720e9e tempest-ProjectReaderTests-1455055525 None] Created volume successfully. Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created reservations ['f3b45fde-cb97-4749-8586-0fa26f701233', '05b286e7-611c-40e8-9eb5-dea1dbd6281f', '3779469e-142a-496a-808b-51f615ed15e3', 'a9cfc51c-a070-4216-aedc-75adcd7bd849'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:43 devstack sudo[114018]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941" returned: 0 in 0.487s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:43 devstack sudo[114029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:43 devstack sudo[114029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b84cc8e-961e-4964-91c3-dac4a0bfccba]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba Aug 26 03:18:43 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack sudo[114022]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 1073741824" returned: 0 in 0.584s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack sudo[114029]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.331s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:43 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Deleted volume successfully. Aug 26 03:18:43 devstack sudo[114036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 Aug 26 03:18:43 devstack sudo[114036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e10d46ae-9f50-4d72-a7bc-607a1daab87a tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-e6629be2-22df-48a2-9683-10ff9e8ff467-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:43 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba" returned: 0 in 0.430s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 Aug 26 03:18:43 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:44 devstack sudo[114036]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89" returned: 0 in 0.343s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e117b1-5337-4f05-8eb8-88b9d0791a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c06df1-4b84-4dbd-b4ce-cdfc26a96143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:44 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Volume volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 (530f20f6-7ab1-4cc0-9504-ac7355c2de89): created successfully Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c06df1-4b84-4dbd-b4ce-cdfc26a96143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Flow 'volume_create_manager' (3337fa80-c2d5-483a-94de-20446512e8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:44 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2f4a6df2-11de-47d7-af43-2403e2d5ab15 tempest-ProjectReaderTests-1336687382 None] Created volume successfully. Aug 26 03:18:44 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941" returned: 0 in 0.433s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:44 devstack sudo[114048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941 Aug 26 03:18:44 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Acquiring lock "cinder-50337156-2b00-4dfd-9f04-e5d2aa7dfead-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "cinder-530f20f6-7ab1-4cc0-9504-ac7355c2de89-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-530f20f6-7ab1-4cc0-9504-ac7355c2de89-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Lock "cinder-50337156-2b00-4dfd-9f04-e5d2aa7dfead-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Acquiring lock "cinder-quobyte-50337156-2b00-4dfd-9f04-e5d2aa7dfead" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-eaaf5f89-7627-4a37-bfe7-450fa0b092ad-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "cinder-quobyte-530f20f6-7ab1-4cc0-9504-ac7355c2de89" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Lock "cinder-quobyte-50337156-2b00-4dfd-9f04-e5d2aa7dfead" acquired by "delete_volume" :: waited 0.052s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-eaaf5f89-7627-4a37-bfe7-450fa0b092ad-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-quobyte-530f20f6-7ab1-4cc0-9504-ac7355c2de89" acquired by "delete_volume" :: waited 0.062s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca68512f-de81-49b6-8a1f-b340570c5037]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b228b13-b82b-4fd3-bdd8-71845d0da0cd]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:44 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba.de8c0471-4f07-4e59-b3b0-a7df0dc2f941" returned: 0 in 0.403s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-quobyte-eaaf5f89-7627-4a37-bfe7-450fa0b092ad" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-quobyte-de8c0471-4f07-4e59-b3b0-a7df0dc2f941" released by "_delete_snapshot" :: held 1.900s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-quobyte-17d431c6-3ea1-44ec-8195-dd32f40c78ba" released by "delete_snapshot" :: held 1.928s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-eaaf5f89-7627-4a37-bfe7-450fa0b092ad" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:44 devstack sudo[114051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead Aug 26 03:18:44 devstack sudo[114051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c521418-2037-4bad-a6f7-a3ae8a030e58]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:44 devstack sudo[114052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 Aug 26 03:18:44 devstack sudo[114052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:44 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Created reservations ['8d43ab1a-6761-4051-b1ac-279f121a1408', 'c2031743-67f4-489f-b451-c6430cfbcf24', '0652f08e-a014-4c05-a220-53535b376f35', '31e0df78-3269-4ee4-b92d-4f924b020b66'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:44 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Delete snapshot completed successfully. Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9a819376-0d92-4f8a-b2c6-753b0bb8bb58 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-de8c0471-4f07-4e59-b3b0-a7df0dc2f941-delete_snapshot" released by "delete_snapshot" :: held 2.161s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:45 devstack sudo[114054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad Aug 26 03:18:45 devstack sudo[114054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack sudo[114051]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack sudo[114052]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89" returned: 0 in 0.445s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead" returned: 0 in 0.485s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack sudo[114063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89 Aug 26 03:18:45 devstack sudo[114063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack sudo[114064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead Aug 26 03:18:45 devstack sudo[114064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack sudo[114054]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad" returned: 0 in 0.491s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack sudo[114070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad Aug 26 03:18:45 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack sudo[114063]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack sudo[114064]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-530f20f6-7ab1-4cc0-9504-ac7355c2de89" returned: 0 in 0.305s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-50337156-2b00-4dfd-9f04-e5d2aa7dfead" returned: 0 in 0.288s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-quobyte-530f20f6-7ab1-4cc0-9504-ac7355c2de89" released by "delete_volume" :: held 0.823s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Lock "cinder-quobyte-50337156-2b00-4dfd-9f04-e5d2aa7dfead" released by "delete_volume" :: held 0.867s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Created reservations ['b44e894f-7bd8-409f-bd33-467baed4fb6e', 'aacdab1d-e959-4a45-a42f-dc7575e38f82', '9819322d-8501-41e6-9861-f1de888c514d', 'f1bbc358-c680-467b-b458-8c115bf54668'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Created reservations ['a877ca67-8883-470a-9f17-654553593e1b', '98fc3b72-55b5-45e9-8d2e-2307876c0bb6', 'd586fe87-2e0f-4a48-bbee-b9948506bf44', '21be597b-8e54-4f2a-9755-f2e28ac9745f'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:45 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-eaaf5f89-7627-4a37-bfe7-450fa0b092ad" returned: 0 in 0.321s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-eaaf5f89-7627-4a37-bfe7-450fa0b092ad" released by "delete_volume" :: held 0.872s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack sudo[114075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:45 devstack sudo[114075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created reservations ['74292752-4a6b-4901-b905-99dab7763e40', '5457a8c8-9458-49a5-af4d-fea58cae93c6', '0685f4cb-22c4-4f1b-802d-90155fcb7168', '96837a88-8e1a-48e9-ad75-745d3de77705'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:45 devstack sudo[114077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:45 devstack sudo[114077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:46 devstack sudo[114079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:46 devstack sudo[114079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:46 devstack sudo[114077]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.388s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "cinder-17d431c6-3ea1-44ec-8195-dd32f40c78ba-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Deleted volume successfully. Aug 26 03:18:46 devstack sudo[114075]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.541s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-17d431c6-3ea1-44ec-8195-dd32f40c78ba-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Deleted volume successfully. Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-178a1b60-edee-410a-b2a7-3ebdd7f150c7 tempest-ProjectReaderTests-1336687382 None] Lock "cinder-530f20f6-7ab1-4cc0-9504-ac7355c2de89-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:46 devstack sudo[114079]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.397s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "cinder-quobyte-17d431c6-3ea1-44ec-8195-dd32f40c78ba" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6c213855-a809-48e5-af7b-39c26c362c7b tempest-ProjectReaderTests-1455055525 None] Lock "cinder-50337156-2b00-4dfd-9f04-e5d2aa7dfead-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Deleted volume successfully. Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-quobyte-17d431c6-3ea1-44ec-8195-dd32f40c78ba" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4a9b8073-9f71-4ac3-a944-e5df8871d696 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-eaaf5f89-7627-4a37-bfe7-450fa0b092ad-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4d3b1a-a5c8-442a-9597-64b4ad54b3dc]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Flow 'volume_create_manager' (33e3a031-04a0-4daf-b34c-89fd1c0d506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a378b8f9-0445-4e17-a7ee-8b2e6760e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a378b8f9-0445-4e17-a7ee-8b2e6760e02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614108491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf4e484-ced9-4fc5-98a1-8eb171ea2866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15401846cda640df8a8fe6ee77c2096e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:46Z,use_quota=True,user_id='d64b098796dd47be9aea29d0bcbf63c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc9a406-5480-4dd6-b74e-2a984c4810b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc9a406-5480-4dd6-b74e-2a984c4810b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b73cb2-735b-4f9a-8fcc-0565dfb569f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b73cb2-735b-4f9a-8fcc-0565dfb569f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf4e484-ced9-4fc5-98a1-8eb171ea2866', 'volume_name': 'volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9c21d9-2ace-41a8-8c49-eaa5bc762e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9c21d9-2ace-41a8-8c49-eaa5bc762e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack sudo[114086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba Aug 26 03:18:46 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffaaa57-6ddb-46c6-a761-e69d2fcf37a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Volume 6cf4e484-ced9-4fc5-98a1-8eb171ea2866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866', 'volume_size': 1} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614108491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf4e484-ced9-4fc5-98a1-8eb171ea2866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15401846cda640df8a8fe6ee77c2096e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:46Z,use_quota=True,user_id='d64b098796dd47be9aea29d0bcbf63c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Creating volume 6cf4e484-ced9-4fc5-98a1-8eb171ea2866 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:46 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:46 devstack sudo[114088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 1073741824 Aug 26 03:18:46 devstack sudo[114088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:46 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-49520068-7ecf-4b06-9651-50c4726d5409-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-49520068-7ecf-4b06-9651-50c4726d5409-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:47 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba" returned: 0 in 0.664s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "cinder-quobyte-49520068-7ecf-4b06-9651-50c4726d5409" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-49520068-7ecf-4b06-9651-50c4726d5409" acquired by "delete_volume" :: waited 0.039s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:47 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba Aug 26 03:18:47 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[5819fb66-4471-4d86-8dad-6500d8136ad4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:47 devstack sudo[114099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 Aug 26 03:18:47 devstack sudo[114099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:47 devstack sudo[114088]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 1073741824" returned: 0 in 0.875s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Flow 'volume_create_manager' (987cc59f-8b73-4e0d-bded-c24bea85baf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0095f3d-8650-4286-afdf-30d2a7e339b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-17d431c6-3ea1-44ec-8195-dd32f40c78ba" returned: 0 in 0.470s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0095f3d-8650-4286-afdf-30d2a7e339b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1080900819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8b9eda-2c3c-4986-93b3-bbaac062a3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f067a83e0edc4db5bfc3e649f7ab5897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:47Z,use_quota=True,user_id='bdc1b95abfa0443ea8afbc783544314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f57b41-ad26-476c-8059-af9ef4be0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f57b41-ad26-476c-8059-af9ef4be0b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a458971b-a190-411b-accb-11d3af4f8c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a458971b-a190-411b-accb-11d3af4f8c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8b9eda-2c3c-4986-93b3-bbaac062a3c2', 'volume_name': 'volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ebb2f9-c3e2-4e0d-84af-62d4e2a66922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ebb2f9-c3e2-4e0d-84af-62d4e2a66922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f9368c-37d9-4e64-babe-a2be3b93b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Volume ca8b9eda-2c3c-4986-93b3-bbaac062a3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2', 'volume_size': 1} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-quobyte-17d431c6-3ea1-44ec-8195-dd32f40c78ba" released by "delete_volume" :: held 1.285s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:47 devstack sudo[114102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 Aug 26 03:18:47 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Created reservations ['bc82ba4a-ce18-4b06-a9dc-7d7cadcc56ad', '06ffd779-6f42-4a4a-90c0-cbda1fce4d72', '00bab2e0-4928-4f1a-aa72-6a9771d5c9d8', '3d8591d2-c98f-42c3-ab48-6797e61447ca'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:47 devstack sudo[114099]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409" returned: 0 in 0.560s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:47 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409 Aug 26 03:18:47 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:47 devstack sudo[114109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:47 devstack sudo[114109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:47 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1080900819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8b9eda-2c3c-4986-93b3-bbaac062a3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f067a83e0edc4db5bfc3e649f7ab5897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:47Z,use_quota=True,user_id='bdc1b95abfa0443ea8afbc783544314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Creating volume ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:48 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffaaa57-6ddb-46c6-a761-e69d2fcf37a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc9b266-0838-4775-83e1-901ac42b9568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:48 devstack sudo[114112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 1073741824 Aug 26 03:18:48 devstack sudo[114112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:48 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Volume volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 (6cf4e484-ced9-4fc5-98a1-8eb171ea2866): created successfully Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc9b266-0838-4775-83e1-901ac42b9568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Flow 'volume_create_manager' (33e3a031-04a0-4daf-b34c-89fd1c0d506e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:48 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-148517cf-0dfd-4be3-aa3f-909e18a61a64 tempest-ProjectReaderTests-1336687382 None] Created volume successfully. Aug 26 03:18:48 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-49520068-7ecf-4b06-9651-50c4726d5409" returned: 0 in 0.355s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-quobyte-49520068-7ecf-4b06-9651-50c4726d5409" released by "delete_volume" :: held 0.996s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:48 devstack sudo[114109]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.318s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:48 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Deleted volume successfully. Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Created reservations ['88290801-475d-4134-8350-ec6c58530787', 'e02dbf5d-57a6-42bc-bc24-1a75710c8dd4', 'a01bfe6c-0412-452d-bceb-420c2e0c105d', '5496b903-777b-4b33-9fff-8e65ab8601b7'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-48e4645a-4b72-4c0d-98be-e6acf0593270 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-17d431c6-3ea1-44ec-8195-dd32f40c78ba-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack sudo[114119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:48 devstack sudo[114119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "cinder-3944686c-c0b1-4a56-8f6f-35629698f231-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:48 devstack sudo[114112]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 1073741824" returned: 0 in 0.613s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-3944686c-c0b1-4a56-8f6f-35629698f231-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Acquiring lock "cinder-6cf4e484-ced9-4fc5-98a1-8eb171ea2866-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:48 devstack sudo[114119]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.370s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Lock "cinder-6cf4e484-ced9-4fc5-98a1-8eb171ea2866-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:48 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Deleted volume successfully. Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 Aug 26 03:18:48 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "cinder-quobyte-3944686c-c0b1-4a56-8f6f-35629698f231" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-quobyte-3944686c-c0b1-4a56-8f6f-35629698f231" acquired by "delete_volume" :: waited 0.028s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e6cc673b-27fc-47ac-b936-5d380ab036f9 tempest-CreateVolumesFromSourceVolumeTest-23929062 None] Lock "cinder-49520068-7ecf-4b06-9651-50c4726d5409-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Acquiring lock "cinder-quobyte-6cf4e484-ced9-4fc5-98a1-8eb171ea2866" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[996a972a-bc8a-4a6d-833b-d6b0948cf9b4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Lock "cinder-quobyte-6cf4e484-ced9-4fc5-98a1-8eb171ea2866" acquired by "delete_volume" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfccc8ed-a7e4-4e8e-853c-d6933eac7c61]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:49 devstack sudo[114125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 Aug 26 03:18:49 devstack sudo[114125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:49 devstack sudo[114126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 Aug 26 03:18:49 devstack sudo[114126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:49 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f9368c-37d9-4e64-babe-a2be3b93b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e1c851-3464-43f2-90d8-419b712da133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:49 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Volume volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 (ca8b9eda-2c3c-4986-93b3-bbaac062a3c2): created successfully Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e1c851-3464-43f2-90d8-419b712da133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Flow 'volume_create_manager' (987cc59f-8b73-4e0d-bded-c24bea85baf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a378b828-947c-4783-826a-071d3294e4d7 tempest-ProjectReaderTests-1455055525 None] Created volume successfully. Aug 26 03:18:49 devstack sudo[114125]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231" returned: 0 in 0.456s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:49 devstack sudo[114136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231 Aug 26 03:18:49 devstack sudo[114136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:49 devstack sudo[114126]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866" returned: 0 in 0.473s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:49 devstack sudo[114138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866 Aug 26 03:18:49 devstack sudo[114138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:49 devstack sudo[114136]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3944686c-c0b1-4a56-8f6f-35629698f231" returned: 0 in 0.338s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-quobyte-3944686c-c0b1-4a56-8f6f-35629698f231" released by "delete_volume" :: held 0.863s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Acquiring lock "cinder-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:49 devstack sudo[114138]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Lock "cinder-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6cf4e484-ced9-4fc5-98a1-8eb171ea2866" returned: 0 in 0.407s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Lock "cinder-quobyte-6cf4e484-ced9-4fc5-98a1-8eb171ea2866" released by "delete_volume" :: held 0.939s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Acquiring lock "cinder-quobyte-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Created reservations ['72ae6758-789e-4923-8075-859763e8f43a', '063c0996-6b07-4826-8cdf-90c09d9727e4', 'a3bf8493-2c99-45d2-b151-9b5c70b924a9', '88c8fdb1-77e9-44c0-993b-bee9140b1665'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Lock "cinder-quobyte-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f8565-1a48-4e1c-96cc-c42425c6c411]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Created reservations ['1ac86c31-48a8-4d1a-89c1-0fcc868de5b7', 'f2ec386f-b8cf-4fcf-9145-95d5cedcd579', '1966eda5-53a0-480b-9d77-82713a6aae9d', '5941d59b-c837-4b68-ad66-8d9dee6d07f4'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:50 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:50 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:50 devstack sudo[114142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 Aug 26 03:18:50 devstack sudo[114142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:50 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:50 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:50 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.346s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Deleted volume successfully. Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e0efcf6f-242c-4c30-a778-e66884d82d96 tempest-CinderUnicodeTest-2061850525 None] Lock "cinder-3944686c-c0b1-4a56-8f6f-35629698f231-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:50 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:50 devstack sudo[114142]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.369s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2" returned: 0 in 0.575s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Deleted volume successfully. Aug 26 03:18:50 devstack sudo[114153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2 Aug 26 03:18:50 devstack sudo[114153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-908a44f2-9083-46ef-aaae-5aa0e296234d tempest-ProjectReaderTests-1336687382 None] Lock "cinder-6cf4e484-ced9-4fc5-98a1-8eb171ea2866-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:50 devstack sudo[114153]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2" returned: 0 in 0.316s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Lock "cinder-quobyte-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2" released by "delete_volume" :: held 0.965s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Created reservations ['4e0de6f5-7f2d-4626-a617-4dcc444a077e', 'a00ff247-4f41-4758-bf9f-cd85ad5c750a', 'f3adbb1e-54ff-4575-841b-4bb3f8f49b9a', '8a19df8b-1b0a-4301-abc2-2152986d3dcd'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:51 devstack sudo[114156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:18:51 devstack sudo[114156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:51 devstack sudo[114156]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.366s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:51 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Deleted volume successfully. Aug 26 03:18:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d81d44a-fe82-45c1-96d9-0fd34593abba tempest-ProjectReaderTests-1455055525 None] Lock "cinder-ca8b9eda-2c3c-4986-93b3-bbaac062a3c2-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (9fd4d49a-f452-46ed-a578-fc5865960ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f167e4-afc0-4909-9f4c-d6bb122c1e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f167e4-afc0-4909-9f4c-d6bb122c1e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045509591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781caa39-b603-4210-b421-556b99e9bebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:55Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdeccd20-9550-4113-97ae-37d74460a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdeccd20-9550-4113-97ae-37d74460a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b60c74-fedf-4ac2-8cc8-7624f798c5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b60c74-fedf-4ac2-8cc8-7624f798c5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781caa39-b603-4210-b421-556b99e9bebd', 'volume_name': 'volume-781caa39-b603-4210-b421-556b99e9bebd', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536ce455-6a83-4153-997e-99d182db5fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536ce455-6a83-4153-997e-99d182db5fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d2e4b3-3916-497b-a87e-96c0c3b6f7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:55 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Volume 781caa39-b603-4210-b421-556b99e9bebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781caa39-b603-4210-b421-556b99e9bebd', 'volume_size': 1} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045509591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781caa39-b603-4210-b421-556b99e9bebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:55Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Creating volume 781caa39-b603-4210-b421-556b99e9bebd {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:55 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:18:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:55 devstack sudo[114159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd 1073741824 Aug 26 03:18:55 devstack sudo[114159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:56 devstack sudo[114159]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd 1073741824" returned: 0 in 0.607s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:56 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd Aug 26 03:18:56 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:56 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd" returned: 0 in 0.377s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d2e4b3-3916-497b-a87e-96c0c3b6f7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781caa39-b603-4210-b421-556b99e9bebd', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b58931-244d-45ea-8d7c-37da1c5a33df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:56 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Volume volume-781caa39-b603-4210-b421-556b99e9bebd (781caa39-b603-4210-b421-556b99e9bebd): created successfully Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b58931-244d-45ea-8d7c-37da1c5a33df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (9fd4d49a-f452-46ed-a578-fc5865960ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5172e49f-d355-4796-8902-9a4da94c92a7 tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:18:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot 152d0efc-ce5b-48af-b78c-fd8e5ba65c17 of volume 781caa39-b603-4210-b421-556b99e9bebd {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:58 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8850bf02-5f97-456a-9b2b-5f69c76dfc8f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd Aug 26 03:18:58 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:58 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd" returned: 0 in 0.507s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack sudo[114209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 1G Aug 26 03:18:58 devstack sudo[114209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack sudo[114209]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 1G" returned: 0 in 0.546s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-781caa39-b603-4210-b421-556b99e9bebd -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-781caa39-b603-4210-b421-556b99e9bebd -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 Aug 26 03:18:59 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-781caa39-b603-4210-b421-556b99e9bebd -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17" returned: 0 in 0.417s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 is being set with open permissions: ugo+rw Aug 26 03:18:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack sudo[114220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 Aug 26 03:18:59 devstack sudo[114220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack sudo[114220]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17" returned: 0 in 0.347s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:00 devstack sudo[114229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.info Aug 26 03:19:00 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.info" returned: 0 in 0.311s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.info is being set with open permissions: ugo+rw Aug 26 03:19:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:00 devstack sudo[114232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.info Aug 26 03:19:00 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.info" returned: 0 in 0.344s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5d84360b-0907-40a3-a8e6-d66edb4fa3f0 tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-152d0efc-ce5b-48af-b78c-fd8e5ba65c17-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-152d0efc-ce5b-48af-b78c-fd8e5ba65c17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-781caa39-b603-4210-b421-556b99e9bebd" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-781caa39-b603-4210-b421-556b99e9bebd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-152d0efc-ce5b-48af-b78c-fd8e5ba65c17" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-152d0efc-ce5b-48af-b78c-fd8e5ba65c17" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot 152d0efc-ce5b-48af-b78c-fd8e5ba65c17 of volume 781caa39-b603-4210-b421-556b99e9bebd {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c364ec3-f23f-4d33-8109-207e9c11216d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:01 devstack sudo[114235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 Aug 26 03:19:01 devstack sudo[114235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:02 devstack sudo[114235]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17" returned: 0 in 0.477s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-781caa39-b603-4210-b421-556b99e9bebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:02 devstack sudo[114240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:02 devstack sudo[114240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9819bedb-e101-4c48-80f3-8932755bd593]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:02 devstack sudo[114242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd Aug 26 03:19:02 devstack sudo[114242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:02 devstack sudo[114240]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:19:02 devstack sudo[114242]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd" returned: 0 in 0.547s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:02 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 Aug 26 03:19:02 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (fc8a14c2-07a0-4c4d-bb27-9db29c06f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccb28db-322f-4d9d-8097-18c0652666b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccb28db-322f-4d9d-8097-18c0652666b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078849433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48a6a7f-e048-4a47-a278-06f8cc134962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:03Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650ff92a-d3d0-4d13-ad03-4eeffa2bac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650ff92a-d3d0-4d13-ad03-4eeffa2bac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c225c4f-a8e9-4445-b97a-fa9852c94f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c225c4f-a8e9-4445-b97a-fa9852c94f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48a6a7f-e048-4a47-a278-06f8cc134962', 'volume_name': 'volume-d48a6a7f-e048-4a47-a278-06f8cc134962', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e23065-6735-4a42-921a-05bb0c2b066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e23065-6735-4a42-921a-05bb0c2b066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6463c89-1bc4-42b1-8215-5adfd6e62f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:02 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Volume d48a6a7f-e048-4a47-a278-06f8cc134962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48a6a7f-e048-4a47-a278-06f8cc134962', 'volume_size': 1} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078849433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48a6a7f-e048-4a47-a278-06f8cc134962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:03Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Creating volume d48a6a7f-e048-4a47-a278-06f8cc134962 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:03 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:03 devstack sudo[114252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 1073741824 Aug 26 03:19:03 devstack sudo[114252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:03 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17" returned: 0 in 0.424s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:03 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17 Aug 26 03:19:03 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:03 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd.152d0efc-ce5b-48af-b78c-fd8e5ba65c17" returned: 0 in 0.345s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-152d0efc-ce5b-48af-b78c-fd8e5ba65c17" released by "_delete_snapshot" :: held 1.970s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-781caa39-b603-4210-b421-556b99e9bebd" released by "delete_snapshot" :: held 2.004s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:03 devstack sudo[114252]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 1073741824" returned: 0 in 0.610s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Created reservations ['6df40135-6f12-4daa-bffe-0cde40f99db1', '94175ebb-6bbc-41a6-9263-7afe7c18ae1f', 'fcae38ec-08c5-43e1-a458-5dd6dc7de709', '6d22c747-c448-430a-8b95-bac24757885b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:03 devstack sudo[114263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 Aug 26 03:19:03 devstack sudo[114263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:03 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5b1c059b-89d8-4b81-babb-3db48ca7fd43 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-152d0efc-ce5b-48af-b78c-fd8e5ba65c17-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:03 devstack sudo[114263]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962" returned: 0 in 0.301s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:03 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6463c89-1bc4-42b1-8215-5adfd6e62f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48a6a7f-e048-4a47-a278-06f8cc134962', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c48d07c-c795-421f-80f4-a23f688e13f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:04 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Volume volume-d48a6a7f-e048-4a47-a278-06f8cc134962 (d48a6a7f-e048-4a47-a278-06f8cc134962): created successfully Aug 26 03:19:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c48d07c-c795-421f-80f4-a23f688e13f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:04 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (fc8a14c2-07a0-4c4d-bb27-9db29c06f411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:04 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2a8ca9ee-0d2a-46e2-a7f8-ae5a8ee6da37 tempest-ProjectReaderTests-561634371 None] Created volume successfully. Aug 26 03:19:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-781caa39-b603-4210-b421-556b99e9bebd-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-781caa39-b603-4210-b421-556b99e9bebd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-781caa39-b603-4210-b421-556b99e9bebd" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:04 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-781caa39-b603-4210-b421-556b99e9bebd" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ba2a03-b5ba-4b0f-ae40-040dca3af545]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:05 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd Aug 26 03:19:05 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Creating offline snapshot aa86742b-cfe7-49a0-bc75-d741fb941d79 of volume d48a6a7f-e048-4a47-a278-06f8cc134962 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d740b73-3e9e-4812-9227-d45e035215c0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:05 devstack sudo[114268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 Aug 26 03:19:05 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:05 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd" returned: 0 in 0.494s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:05 devstack sudo[114273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd Aug 26 03:19:05 devstack sudo[114273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:05 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962" returned: 0 in 0.497s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:05 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 1G Aug 26 03:19:05 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:05 devstack sudo[114273]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-781caa39-b603-4210-b421-556b99e9bebd" returned: 0 in 0.324s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-781caa39-b603-4210-b421-556b99e9bebd" released by "delete_volume" :: held 0.904s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:05 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Created reservations ['9afdab22-a3e8-44be-8b8a-81ba27d4ef1b', '9518ec44-d3d6-43df-ad95-1fc805f2de9a', 'd149fbea-a48c-4dab-bdc2-50360c0b055d', '5b1b3b03-1a85-4ea5-b86b-97882e0eb25d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:06 devstack sudo[114282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:06 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:06 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 1G" returned: 0 in 0.663s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48a6a7f-e048-4a47-a278-06f8cc134962 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:06 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.406s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:06 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48a6a7f-e048-4a47-a278-06f8cc134962 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 Aug 26 03:19:06 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5098081a-c5f5-40a9-83fb-cebf5be979f4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-781caa39-b603-4210-b421-556b99e9bebd-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (3b576f23-08b9-4b21-b09b-ab4c5d2fb888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d1b38b-71bc-433c-8204-6fe075817d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d1b38b-71bc-433c-8204-6fe075817d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952283551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82a6dcf-e88d-4b07-8db7-59b07153376c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:07Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35b5f37-f3e9-4ad7-9b0d-4eb5c5daef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35b5f37-f3e9-4ad7-9b0d-4eb5c5daef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e689ddf3-bd5f-4768-bc60-2535fe2b7d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e689ddf3-bd5f-4768-bc60-2535fe2b7d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82a6dcf-e88d-4b07-8db7-59b07153376c', 'volume_name': 'volume-b82a6dcf-e88d-4b07-8db7-59b07153376c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d32b72-2b50-46ff-b121-ff211e61c9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d32b72-2b50-46ff-b121-ff211e61c9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaa813d-f634-44db-bb82-f3b858b28f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Volume b82a6dcf-e88d-4b07-8db7-59b07153376c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82a6dcf-e88d-4b07-8db7-59b07153376c', 'volume_size': 1} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48a6a7f-e048-4a47-a278-06f8cc134962 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79" returned: 0 in 0.414s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:06 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 is being set with open permissions: ugo+rw Aug 26 03:19:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:06 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 Aug 26 03:19:06 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:07 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79" returned: 0 in 0.293s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:07 devstack sudo[114299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.info Aug 26 03:19:07 devstack sudo[114299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:07 devstack sudo[114299]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.info" returned: 0 in 0.293s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:07 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.info is being set with open permissions: ugo+rw Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:07 devstack sudo[114302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.info Aug 26 03:19:07 devstack sudo[114302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:07 devstack sudo[114302]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.info" returned: 0 in 0.300s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952283551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82a6dcf-e88d-4b07-8db7-59b07153376c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:07Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Creating volume b82a6dcf-e88d-4b07-8db7-59b07153376c {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:07 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:07 devstack sudo[114305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c 1073741824 Aug 26 03:19:07 devstack sudo[114305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:07 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a582c9ea-a6d6-45a0-8d18-7d24aefc98d9 tempest-ProjectReaderTests-561634371 None] Create snapshot completed successfully Aug 26 03:19:08 devstack sudo[114305]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c 1073741824" returned: 0 in 0.531s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:08 devstack sudo[114311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c Aug 26 03:19:08 devstack sudo[114311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:08 devstack sudo[114311]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c" returned: 0 in 0.319s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaa813d-f634-44db-bb82-f3b858b28f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82a6dcf-e88d-4b07-8db7-59b07153376c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dfa74c-6669-47c1-aeb6-0f27c6a17a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:08 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Volume volume-b82a6dcf-e88d-4b07-8db7-59b07153376c (b82a6dcf-e88d-4b07-8db7-59b07153376c): created successfully Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dfa74c-6669-47c1-aeb6-0f27c6a17a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (3b576f23-08b9-4b21-b09b-ab4c5d2fb888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0c70e5da-0050-4967-9854-b517ddecf9ab tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-aa86742b-cfe7-49a0-bc75-d741fb941d79-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Lock "cinder-aa86742b-cfe7-49a0-bc75-d741fb941d79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-d48a6a7f-e048-4a47-a278-06f8cc134962" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-d48a6a7f-e048-4a47-a278-06f8cc134962" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-aa86742b-cfe7-49a0-bc75-d741fb941d79" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-aa86742b-cfe7-49a0-bc75-d741fb941d79" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Deleting offline snapshot aa86742b-cfe7-49a0-bc75-d741fb941d79 of volume d48a6a7f-e048-4a47-a278-06f8cc134962 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] snapshot_file for this snap is: volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cadb75-9075-4c9c-8bef-3c4b3a43013d]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:09 devstack sudo[114314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 Aug 26 03:19:09 devstack sudo[114314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:09 devstack sudo[114314]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79" returned: 0 in 0.464s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:09 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d48a6a7f-e048-4a47-a278-06f8cc134962(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:09 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0820ee8-bead-4c80-990b-e81e1a3e6f9e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:09 devstack sudo[114319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 Aug 26 03:19:09 devstack sudo[114319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack sudo[114319]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962" returned: 0 in 0.501s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack sudo[114324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 Aug 26 03:19:10 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot 6c457ce5-54c4-46c7-94b2-fc18093e169c of volume b82a6dcf-e88d-4b07-8db7-59b07153376c {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4027a9-ae31-441a-8f33-d9fcbc6d0bab]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack sudo[114326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c Aug 26 03:19:10 devstack sudo[114326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79" returned: 0 in 0.556s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack sudo[114331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79 Aug 26 03:19:10 devstack sudo[114331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack sudo[114326]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c" returned: 0 in 0.581s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c 1G Aug 26 03:19:10 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack sudo[114331]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962.aa86742b-cfe7-49a0-bc75-d741fb941d79" returned: 0 in 0.434s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-aa86742b-cfe7-49a0-bc75-d741fb941d79" released by "_delete_snapshot" :: held 2.092s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-d48a6a7f-e048-4a47-a278-06f8cc134962" released by "delete_snapshot" :: held 2.124s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Created reservations ['66e95231-6afd-4a0f-b73d-f4579dbe7da4', '2f4e473f-c939-435d-a223-6553741f0b52', '6488abe1-9304-4bf5-9366-8c28ceed08a9', 'd44c652b-d47a-46d4-8253-fb95045e2439'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:11 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Delete snapshot completed successfully. Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-1dfb1647-cf58-4b8a-8456-f66499dbe0f2 tempest-ProjectReaderTests-561634371 None] Lock "cinder-aa86742b-cfe7-49a0-bc75-d741fb941d79-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:11 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c 1G" returned: 0 in 0.617s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82a6dcf-e88d-4b07-8db7-59b07153376c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:11 devstack sudo[114344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82a6dcf-e88d-4b07-8db7-59b07153376c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c Aug 26 03:19:11 devstack sudo[114344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:11 devstack sudo[114344]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82a6dcf-e88d-4b07-8db7-59b07153376c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c" returned: 0 in 0.430s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:11 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c is being set with open permissions: ugo+rw Aug 26 03:19:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:11 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c Aug 26 03:19:11 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-d48a6a7f-e048-4a47-a278-06f8cc134962-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Lock "cinder-d48a6a7f-e048-4a47-a278-06f8cc134962-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:12 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-d48a6a7f-e048-4a47-a278-06f8cc134962" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c" returned: 0 in 0.341s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-d48a6a7f-e048-4a47-a278-06f8cc134962" acquired by "delete_volume" :: waited 0.036s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[483334c1-3da8-46c5-93ec-5ee94f7ee437]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.info Aug 26 03:19:12 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack sudo[114353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 Aug 26 03:19:12 devstack sudo[114353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.info" returned: 0 in 0.286s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:12 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.info is being set with open permissions: ugo+rw Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack sudo[114357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.info Aug 26 03:19:12 devstack sudo[114357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack sudo[114353]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962" returned: 0 in 0.445s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962 Aug 26 03:19:12 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack sudo[114357]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.info" returned: 0 in 0.287s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.716s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b6a51976-c057-4f16-a94a-307044c132c2 tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:19:13 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d48a6a7f-e048-4a47-a278-06f8cc134962" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-d48a6a7f-e048-4a47-a278-06f8cc134962" released by "delete_volume" :: held 0.855s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Created reservations ['3734bb55-3f26-440d-b519-9615d5930615', 'a1ed486c-93fd-403d-bb2b-770496243969', '1c552461-9ac0-4fa2-bb3d-cd842f3501e2', '79b972b0-9b5d-483b-a1eb-dd9c426c873e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:13 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:13 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-6c457ce5-54c4-46c7-94b2-fc18093e169c-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-6c457ce5-54c4-46c7-94b2-fc18093e169c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-b82a6dcf-e88d-4b07-8db7-59b07153376c" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-b82a6dcf-e88d-4b07-8db7-59b07153376c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-6c457ce5-54c4-46c7-94b2-fc18093e169c" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6c457ce5-54c4-46c7-94b2-fc18093e169c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot 6c457ce5-54c4-46c7-94b2-fc18093e169c of volume b82a6dcf-e88d-4b07-8db7-59b07153376c {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:13 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8042d1ec-6156-469e-95c2-3ad0b4515df1]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Deleted volume successfully. Aug 26 03:19:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8eaa03bc-19ac-47b1-94a0-25a80827137e tempest-ProjectReaderTests-561634371 None] Lock "cinder-d48a6a7f-e048-4a47-a278-06f8cc134962-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:13 devstack sudo[114370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c Aug 26 03:19:13 devstack sudo[114370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (e8bcfb22-4549-4c58-b601-c210934821ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6432cc-d5ec-4f32-bfb7-fc0cbcaf70c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6432cc-d5ec-4f32-bfb7-fc0cbcaf70c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536259399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be28788-48cf-4da9-a4d7-f8975197eeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:14Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a34b56b-eaf5-4f9e-b6e0-6e2af04bc850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a34b56b-eaf5-4f9e-b6e0-6e2af04bc850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d26508-1b05-40f1-9e35-60295b1e54d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d26508-1b05-40f1-9e35-60295b1e54d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be28788-48cf-4da9-a4d7-f8975197eeec', 'volume_name': 'volume-9be28788-48cf-4da9-a4d7-f8975197eeec', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2c23f6-2dc3-4614-9731-bd2703305e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2c23f6-2dc3-4614-9731-bd2703305e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc61019c-7f64-4dd6-8310-3e2f6a01a272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:14 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Volume 9be28788-48cf-4da9-a4d7-f8975197eeec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be28788-48cf-4da9-a4d7-f8975197eeec', 'volume_size': 1} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:14 devstack sudo[114370]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536259399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be28788-48cf-4da9-a4d7-f8975197eeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:14Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Creating volume 9be28788-48cf-4da9-a4d7-f8975197eeec {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:14 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c" returned: 0 in 0.604s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82a6dcf-e88d-4b07-8db7-59b07153376c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:14 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec 1073741824 Aug 26 03:19:14 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4faf37-97d6-4c76-b774-53cb40c555db]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack sudo[114377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c Aug 26 03:19:14 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c" returned: 0 in 0.529s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec 1073741824" returned: 0 in 0.597s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:14 devstack sudo[114386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c Aug 26 03:19:14 devstack sudo[114386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec Aug 26 03:19:14 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:15 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec" returned: 0 in 0.305s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc61019c-7f64-4dd6-8310-3e2f6a01a272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be28788-48cf-4da9-a4d7-f8975197eeec', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00add404-149d-472c-8c50-bc27ff408bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Volume volume-9be28788-48cf-4da9-a4d7-f8975197eeec (9be28788-48cf-4da9-a4d7-f8975197eeec): created successfully Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00add404-149d-472c-8c50-bc27ff408bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (e8bcfb22-4549-4c58-b601-c210934821ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:15 devstack sudo[114386]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c" returned: 0 in 0.447s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-b7bdf7dd-3c60-477e-bf0f-f75a67644ca9 tempest-ProjectReaderTests-561634371 None] Created volume successfully. Aug 26 03:19:15 devstack sudo[114395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c Aug 26 03:19:15 devstack sudo[114395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:15 devstack sudo[114395]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c.6c457ce5-54c4-46c7-94b2-fc18093e169c" returned: 0 in 0.295s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6c457ce5-54c4-46c7-94b2-fc18093e169c" released by "_delete_snapshot" :: held 2.050s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-b82a6dcf-e88d-4b07-8db7-59b07153376c" released by "delete_snapshot" :: held 2.085s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Created reservations ['a0b1bfd9-33e7-4215-a1ea-52d0e5de33ee', 'bb303532-0eb7-447d-a7c3-adfd3f8ffe0a', 'f36bd899-7f94-406e-a3a7-b2abd167710b', '856e6978-5dd0-432b-8484-e701b1816a64'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:19:15 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2d76a5a4-0eeb-49bc-aea1-26453911fca4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-6c457ce5-54c4-46c7-94b2-fc18093e169c-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Creating offline snapshot c6610268-7d00-4886-a861-0b5b9ee5eac7 of volume 9be28788-48cf-4da9-a4d7-f8975197eeec {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb9a0e1-55b0-4cef-a958-5b93f5e38a6f]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:16 devstack sudo[114399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec Aug 26 03:19:16 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:16 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec" returned: 0 in 0.451s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-b82a6dcf-e88d-4b07-8db7-59b07153376c-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:16 devstack sudo[114404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 1G Aug 26 03:19:16 devstack sudo[114404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-b82a6dcf-e88d-4b07-8db7-59b07153376c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-b82a6dcf-e88d-4b07-8db7-59b07153376c" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:16 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-b82a6dcf-e88d-4b07-8db7-59b07153376c" acquired by "delete_volume" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[162a50cd-4364-4c62-ae37-ef102ddd6a72]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c Aug 26 03:19:17 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack sudo[114404]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 1G" returned: 0 in 0.590s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be28788-48cf-4da9-a4d7-f8975197eeec -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack sudo[114415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be28788-48cf-4da9-a4d7-f8975197eeec -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 Aug 26 03:19:17 devstack sudo[114415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c" returned: 0 in 0.515s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c Aug 26 03:19:17 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack sudo[114415]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be28788-48cf-4da9-a4d7-f8975197eeec -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7" returned: 0 in 0.389s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 is being set with open permissions: ugo+rw Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-b82a6dcf-e88d-4b07-8db7-59b07153376c" returned: 0 in 0.323s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack sudo[114425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 Aug 26 03:19:17 devstack sudo[114425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-b82a6dcf-e88d-4b07-8db7-59b07153376c" released by "delete_volume" :: held 0.932s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:17 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Created reservations ['7a9763ef-d50f-41d2-b470-ab6f766d267a', '1be473eb-fd95-444f-81a9-73fe4d918adb', 'a52b3935-5d1c-49c0-819b-94da9c918964', 'e6dd2185-88c2-4483-a4ee-7730ff07284e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:18 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:18 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:18 devstack sudo[114425]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7" returned: 0 in 0.324s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:18 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.info Aug 26 03:19:18 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:18 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.303s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:18 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-077f8f4b-add1-4a46-ad09-8262ab4d6375 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-b82a6dcf-e88d-4b07-8db7-59b07153376c-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:18 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.info" returned: 0 in 0.337s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:18 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.info is being set with open permissions: ugo+rw Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:18 devstack sudo[114434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.info Aug 26 03:19:18 devstack sudo[114434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:18 devstack sudo[114434]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.info" returned: 0 in 0.318s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:18 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-472aacfe-7d3d-4368-b21a-4ac0dd71d9f7 tempest-ProjectReaderTests-561634371 None] Create snapshot completed successfully Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-c6610268-7d00-4886-a861-0b5b9ee5eac7-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Lock "cinder-c6610268-7d00-4886-a861-0b5b9ee5eac7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-9be28788-48cf-4da9-a4d7-f8975197eeec" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-9be28788-48cf-4da9-a4d7-f8975197eeec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-c6610268-7d00-4886-a861-0b5b9ee5eac7" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (d3b9b7c0-d6ea-4820-87a4-ad9fcd74e14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8771d242-54dc-49c3-92a7-868baeaef230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-c6610268-7d00-4886-a861-0b5b9ee5eac7" acquired by "_delete_snapshot" :: waited 0.088s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Deleting offline snapshot c6610268-7d00-4886-a861-0b5b9ee5eac7 of volume 9be28788-48cf-4da9-a4d7-f8975197eeec {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] snapshot_file for this snap is: volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8771d242-54dc-49c3-92a7-868baeaef230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994810828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86b97c8-7d8e-4f73-a649-8f328b7fa118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:20Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1298ac-c511-4011-bb3c-f31108e1281a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1298ac-c511-4011-bb3c-f31108e1281a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728c7870-9dc5-4706-b08c-856e1f8d775b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728c7870-9dc5-4706-b08c-856e1f8d775b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd86b97c8-7d8e-4f73-a649-8f328b7fa118', 'volume_name': 'volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b94cd2-0757-4c1a-bcee-260457213d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b94cd2-0757-4c1a-bcee-260457213d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1a7e32-910a-42a5-ba8d-746028397c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:19 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Volume d86b97c8-7d8e-4f73-a649-8f328b7fa118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118', 'volume_size': 1} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994810828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86b97c8-7d8e-4f73-a649-8f328b7fa118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:20Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Creating volume d86b97c8-7d8e-4f73-a649-8f328b7fa118 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:19 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c30201f-385e-48b6-9baf-c6ea1897bb4c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:19 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 1073741824 Aug 26 03:19:19 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 Aug 26 03:19:20 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7" returned: 0 in 0.462s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9be28788-48cf-4da9-a4d7-f8975197eeec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d424f7-453f-4506-a6cb-3e712470d686]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:20 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 1073741824" returned: 0 in 0.517s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:20 devstack sudo[114448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 Aug 26 03:19:20 devstack sudo[114448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec Aug 26 03:19:20 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack sudo[114448]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118" returned: 0 in 0.331s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1a7e32-910a-42a5-ba8d-746028397c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9906b5d6-eba2-4f6c-94d9-8e70457dd57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:20 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Volume volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 (d86b97c8-7d8e-4f73-a649-8f328b7fa118): created successfully Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9906b5d6-eba2-4f6c-94d9-8e70457dd57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (d3b9b7c0-d6ea-4820-87a4-ad9fcd74e14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:20 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec" returned: 0 in 0.455s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:20 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9bd1e68f-30b9-43fc-af9d-0dfbe1bbbd56 tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:19:20 devstack sudo[114456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 Aug 26 03:19:20 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:21 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7" returned: 0 in 0.511s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:21 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7 Aug 26 03:19:21 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:21 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec.c6610268-7d00-4886-a861-0b5b9ee5eac7" returned: 0 in 0.316s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-c6610268-7d00-4886-a861-0b5b9ee5eac7" released by "_delete_snapshot" :: held 1.940s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-9be28788-48cf-4da9-a4d7-f8975197eeec" released by "delete_snapshot" :: held 2.045s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:21 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Created reservations ['72ea5079-08c2-4cdd-9a08-74e99dadc10c', '63a11b5f-e233-422b-8d6b-a9b28d4559b8', 'c1cda565-a70c-4105-8578-061141f8f295', '92104835-fe3c-4b84-b86f-6d2540a83744'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:21 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Delete snapshot completed successfully. Aug 26 03:19:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f5c5b2fb-a378-4818-aaec-4077e9205f07 tempest-ProjectReaderTests-561634371 None] Lock "cinder-c6610268-7d00-4886-a861-0b5b9ee5eac7-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot c68ac89a-388a-44aa-a73f-8e028499d0fa of volume d86b97c8-7d8e-4f73-a649-8f328b7fa118 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb313da-9feb-4c45-8395-3d4bf4d34fd3]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 Aug 26 03:19:22 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118" returned: 0 in 0.449s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack sudo[114470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa 1G Aug 26 03:19:22 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-9be28788-48cf-4da9-a4d7-f8975197eeec-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:22 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Lock "cinder-9be28788-48cf-4da9-a4d7-f8975197eeec-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-9be28788-48cf-4da9-a4d7-f8975197eeec" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-9be28788-48cf-4da9-a4d7-f8975197eeec" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c4d32c-a0f7-4490-ac81-257ca24fda9b]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:23 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa 1G" returned: 0 in 0.571s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:23 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa Aug 26 03:19:23 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:23 devstack sudo[114476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec Aug 26 03:19:23 devstack sudo[114476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:23 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa" returned: 0 in 0.370s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:23 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa is being set with open permissions: ugo+rw Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:23 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa Aug 26 03:19:23 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:23 devstack sudo[114476]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec" returned: 0 in 0.490s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:23 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec Aug 26 03:19:23 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:23 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa" returned: 0 in 0.314s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:23 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-9be28788-48cf-4da9-a4d7-f8975197eeec" returned: 0 in 0.311s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:23 devstack sudo[114494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.info Aug 26 03:19:23 devstack sudo[114494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-9be28788-48cf-4da9-a4d7-f8975197eeec" released by "delete_volume" :: held 0.892s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:23 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Created reservations ['bbc8c2b0-69e5-48c1-836e-7ff622ee1d31', '8baddfa7-2629-4fbd-997b-bddb38c8178f', 'ce745739-dd4a-48fa-bff9-4d2f9f6f03c6', '68a1bb82-85cd-4bfe-b676-763631908fe9'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:24 devstack sudo[114497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:24 devstack sudo[114497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack sudo[114494]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.info" returned: 0 in 0.365s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:24 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.info is being set with open permissions: ugo+rw Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:24 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.info Aug 26 03:19:24 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack sudo[114497]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.384s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:24 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Deleted volume successfully. Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-60570329-95bd-4914-80a1-cc9051f0e754 tempest-ProjectReaderTests-561634371 None] Lock "cinder-9be28788-48cf-4da9-a4d7-f8975197eeec-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:24 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.info" returned: 0 in 0.449s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:24 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-58009ccb-632a-4619-8f8a-b61197cf4aa6 tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:19:24 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (c643389f-4c64-45e7-be7b-bf9b225a831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d668e4dd-d0be-4ac5-9011-22a3eb87d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d668e4dd-d0be-4ac5-9011-22a3eb87d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693078733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f34cc28-1748-4874-90fe-24420b4dd83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:25Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea2f451-447c-4b5a-9a6a-7c02d182768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea2f451-447c-4b5a-9a6a-7c02d182768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83be16d3-b011-4f82-9b24-5f101ddd0e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83be16d3-b011-4f82-9b24-5f101ddd0e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f34cc28-1748-4874-90fe-24420b4dd83c', 'volume_name': 'volume-3f34cc28-1748-4874-90fe-24420b4dd83c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f52067-6dde-427c-a607-129c567fae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f52067-6dde-427c-a607-129c567fae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f3a760-8169-492d-b0c7-8f08b7e88af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:25 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Volume 3f34cc28-1748-4874-90fe-24420b4dd83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f34cc28-1748-4874-90fe-24420b4dd83c', 'volume_size': 1} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693078733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f34cc28-1748-4874-90fe-24420b4dd83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:25Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Creating volume 3f34cc28-1748-4874-90fe-24420b4dd83c {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:25 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:25 devstack sudo[114503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c 1073741824 Aug 26 03:19:25 devstack sudo[114503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-c68ac89a-388a-44aa-a73f-8e028499d0fa-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-c68ac89a-388a-44aa-a73f-8e028499d0fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-d86b97c8-7d8e-4f73-a649-8f328b7fa118" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-d86b97c8-7d8e-4f73-a649-8f328b7fa118" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-c68ac89a-388a-44aa-a73f-8e028499d0fa" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-c68ac89a-388a-44aa-a73f-8e028499d0fa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot c68ac89a-388a-44aa-a73f-8e028499d0fa of volume d86b97c8-7d8e-4f73-a649-8f328b7fa118 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e07f96-a14c-47d0-aa36-1bb910cb716e]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:25 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa Aug 26 03:19:25 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:25 devstack sudo[114503]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c 1073741824" returned: 0 in 0.621s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:25 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c Aug 26 03:19:25 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:25 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa" returned: 0 in 0.509s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[3460c767-dec1-41dd-a1c3-6c390050abeb]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:26 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c" returned: 0 in 0.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f3a760-8169-492d-b0c7-8f08b7e88af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f34cc28-1748-4874-90fe-24420b4dd83c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2c9cc3-f778-4594-8a31-c9046c20a68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:26 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Volume volume-3f34cc28-1748-4874-90fe-24420b4dd83c (3f34cc28-1748-4874-90fe-24420b4dd83c): created successfully Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2c9cc3-f778-4594-8a31-c9046c20a68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (c643389f-4c64-45e7-be7b-bf9b225a831d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6944ff06-bb3f-459e-817a-3f57f8c2fe29 tempest-ProjectReaderTests-561634371 None] Created volume successfully. Aug 26 03:19:26 devstack sudo[114517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 Aug 26 03:19:26 devstack sudo[114517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:26 devstack sudo[114517]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118" returned: 0 in 0.436s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:26 devstack sudo[114523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa Aug 26 03:19:26 devstack sudo[114523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:26 devstack sudo[114523]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa" returned: 0 in 0.404s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:26 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa Aug 26 03:19:26 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:27 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118.c68ac89a-388a-44aa-a73f-8e028499d0fa" returned: 0 in 0.321s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-c68ac89a-388a-44aa-a73f-8e028499d0fa" released by "_delete_snapshot" :: held 1.825s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-d86b97c8-7d8e-4f73-a649-8f328b7fa118" released by "delete_snapshot" :: held 1.862s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Creating offline snapshot 34922bae-a44a-4e43-82e7-c8757b295d6b of volume 3f34cc28-1748-4874-90fe-24420b4dd83c {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bfea9d-c59e-4603-bb6b-2282115cd41c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Created reservations ['8196680d-1bc0-4f32-9ad1-d7409363e8e1', '01c2fd39-cd7d-4ff1-a6e7-31c832cca01d', 'f15578ee-5bf6-479b-a702-ae0033573d42', 'fb72904d-172b-414a-9625-10680db2347c'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:27 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2be40376-46ca-4e46-92da-088713499c1e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-c68ac89a-388a-44aa-a73f-8e028499d0fa-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:27 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c Aug 26 03:19:27 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-d86b97c8-7d8e-4f73-a649-8f328b7fa118-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-d86b97c8-7d8e-4f73-a649-8f328b7fa118-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-d86b97c8-7d8e-4f73-a649-8f328b7fa118" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-d86b97c8-7d8e-4f73-a649-8f328b7fa118" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[07335a1c-fdfc-4725-9efe-ec09d1aa817c]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:27 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 Aug 26 03:19:27 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:27 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c" returned: 0 in 0.547s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:27 devstack sudo[114539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b 1G Aug 26 03:19:27 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:28 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118" returned: 0 in 0.454s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:28 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118 Aug 26 03:19:28 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:28 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b 1G" returned: 0 in 0.587s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f34cc28-1748-4874-90fe-24420b4dd83c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:28 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f34cc28-1748-4874-90fe-24420b4dd83c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b Aug 26 03:19:28 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:28 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-d86b97c8-7d8e-4f73-a649-8f328b7fa118" returned: 0 in 0.389s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-d86b97c8-7d8e-4f73-a649-8f328b7fa118" released by "delete_volume" :: held 0.934s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Created reservations ['db00e52b-0113-483f-8f6b-54946f1e565f', '0e4f0ef1-a845-44a9-896f-f9f2af102f36', '1737b7d3-bc9e-4e25-a953-5bf92084ec73', '1596a3a3-7185-4758-8a10-6bc57372af95'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:28 devstack sudo[114557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:28 devstack sudo[114557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:28 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f34cc28-1748-4874-90fe-24420b4dd83c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b" returned: 0 in 0.417s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:28 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b is being set with open permissions: ugo+rw Aug 26 03:19:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:28 devstack sudo[114559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b Aug 26 03:19:28 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:29 devstack sudo[114557]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.357s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:19:29 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b" returned: 0 in 0.316s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2e82cbcf-a187-44c6-8d25-b4cdb01253c2 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-d86b97c8-7d8e-4f73-a649-8f328b7fa118-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:29 devstack sudo[114563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.info Aug 26 03:19:29 devstack sudo[114563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:29 devstack sudo[114563]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.info" returned: 0 in 0.284s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:29 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.info is being set with open permissions: ugo+rw Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:29 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.info Aug 26 03:19:29 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:29 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.info" returned: 0 in 0.322s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.594s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:29 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8972f660-a3f6-4c63-9397-bd61c63fcf88 tempest-ProjectReaderTests-561634371 None] Create snapshot completed successfully Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Flow 'volume_create_manager' (bb992dcf-6d70-4bfd-8f6f-f684c1ce4f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48859c3-4520-43e9-9143-0918045387fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48859c3-4520-43e9-9143-0918045387fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-346641401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7974d10-ed23-4e8a-be9d-d5638701205c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f12bb5a57418babc6d69f6537c9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:30Z,use_quota=True,user_id='94492a3bd242441a934501bf82c1ebba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5506d5b0-6000-4edc-bfd9-a5f89ea31f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:29 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5506d5b0-6000-4edc-bfd9-a5f89ea31f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f984f0c-5f7a-425f-8067-7ee11d967508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f984f0c-5f7a-425f-8067-7ee11d967508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7974d10-ed23-4e8a-be9d-d5638701205c', 'volume_name': 'volume-c7974d10-ed23-4e8a-be9d-d5638701205c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe550c1-ea3c-4e8a-9b70-a785bb75c0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe550c1-ea3c-4e8a-9b70-a785bb75c0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fd99c4-c60f-4021-97c1-5a19885b6a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Volume c7974d10-ed23-4e8a-be9d-d5638701205c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7974d10-ed23-4e8a-be9d-d5638701205c', 'volume_size': 1} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-346641401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7974d10-ed23-4e8a-be9d-d5638701205c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f12bb5a57418babc6d69f6537c9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:30Z,use_quota=True,user_id='94492a3bd242441a934501bf82c1ebba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Creating volume c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:30 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:30 devstack sudo[114569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c 1073741824 Aug 26 03:19:30 devstack sudo[114569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (12826757-dc82-4ad7-b8ec-37664f4669d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9365cac-9cf5-47ba-8171-9712be59832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9365cac-9cf5-47ba-8171-9712be59832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1906865211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca2d666-a69f-4c60-bd7e-fe42d7d24834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:30Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e983d392-5af5-46c0-a409-38617e57f5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e983d392-5af5-46c0-a409-38617e57f5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3e733d-fe87-42cd-bcb7-80b9a0f7ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3e733d-fe87-42cd-bcb7-80b9a0f7ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca2d666-a69f-4c60-bd7e-fe42d7d24834', 'volume_name': 'volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31159bf-dc48-4815-8184-a12871c13d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31159bf-dc48-4815-8184-a12871c13d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe80541-a546-43c0-b608-b886c41893f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:30 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Volume 8ca2d666-a69f-4c60-bd7e-fe42d7d24834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834', 'volume_size': 1} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-34922bae-a44a-4e43-82e7-c8757b295d6b-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Lock "cinder-34922bae-a44a-4e43-82e7-c8757b295d6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-3f34cc28-1748-4874-90fe-24420b4dd83c" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-3f34cc28-1748-4874-90fe-24420b4dd83c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-34922bae-a44a-4e43-82e7-c8757b295d6b" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-34922bae-a44a-4e43-82e7-c8757b295d6b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Deleting offline snapshot 34922bae-a44a-4e43-82e7-c8757b295d6b of volume 3f34cc28-1748-4874-90fe-24420b4dd83c {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:30 devstack sudo[114569]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] snapshot_file for this snap is: volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c 1073741824" returned: 0 in 0.600s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2182628b-cb79-4d56-af61-0e6792a8f488]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:30 devstack sudo[114576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c Aug 26 03:19:30 devstack sudo[114576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:30 devstack sudo[114575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b Aug 26 03:19:30 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:30 devstack sudo[114576]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c" returned: 0 in 0.281s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1906865211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca2d666-a69f-4c60-bd7e-fe42d7d24834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:30Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Creating volume 8ca2d666-a69f-4c60-bd7e-fe42d7d24834 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:30 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:30 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fd99c4-c60f-4021-97c1-5a19885b6a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7974d10-ed23-4e8a-be9d-d5638701205c', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a03a42-3b7e-4392-a73b-5522b2c02cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:31 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 1073741824 Aug 26 03:19:31 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Volume volume-c7974d10-ed23-4e8a-be9d-d5638701205c (c7974d10-ed23-4e8a-be9d-d5638701205c): created successfully Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a03a42-3b7e-4392-a73b-5522b2c02cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:31 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Flow 'volume_create_manager' (bb992dcf-6d70-4bfd-8f6f-f684c1ce4f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b" returned: 0 in 0.403s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f34cc28-1748-4874-90fe-24420b4dd83c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a09085da-ab70-45e7-80d0-ebb16797ca6e tempest-SnapshotDependencyTests-182462297 None] Created volume successfully. Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b184f-aa31-4ea2-bd73-93adfce479c8]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:31 devstack sudo[114585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c Aug 26 03:19:31 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:31 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 1073741824" returned: 0 in 0.488s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:31 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c" returned: 0 in 0.404s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:31 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b Aug 26 03:19:31 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:31 devstack sudo[114595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 Aug 26 03:19:31 devstack sudo[114595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:31 devstack sudo[114595]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" returned: 0 in 0.285s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe80541-a546-43c0-b608-b886c41893f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afb37ef-20fe-46c4-94c0-4304d73ed463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:31 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Volume volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 (8ca2d666-a69f-4c60-bd7e-fe42d7d24834): created successfully Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afb37ef-20fe-46c4-94c0-4304d73ed463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (12826757-dc82-4ad7-b8ec-37664f4669d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:31 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-40601a37-c6d9-4a2b-b580-f71dd8c3f436 tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:19:31 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b" returned: 0 in 0.406s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:31 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:31 devstack sudo[114601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b Aug 26 03:19:31 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:32 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c.34922bae-a44a-4e43-82e7-c8757b295d6b" returned: 0 in 0.303s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-34922bae-a44a-4e43-82e7-c8757b295d6b" released by "_delete_snapshot" :: held 1.643s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-3f34cc28-1748-4874-90fe-24420b4dd83c" released by "delete_snapshot" :: held 1.670s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Creating offline snapshot 69e16bbc-4baa-4813-a8d6-5016cee249b9 of volume c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2329f700-4a87-4115-b5a4-f7236322e497]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Created reservations ['a2114c45-3a7c-4fbb-8353-a804a8f0309d', 'cb424d7f-a845-4cc1-b272-cd9ffb9120d3', 'de0f9bae-b18e-4a12-a7e3-ced1d509f60c', 'f183b4ec-2046-47e2-ac69-8bf53e819844'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:32 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Delete snapshot completed successfully. Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e980e139-28b2-4ffa-bf7e-27a4056f9bda tempest-ProjectReaderTests-561634371 None] Lock "cinder-34922bae-a44a-4e43-82e7-c8757b295d6b-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:32 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c Aug 26 03:19:32 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-3f34cc28-1748-4874-90fe-24420b4dd83c-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Lock "cinder-3f34cc28-1748-4874-90fe-24420b4dd83c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-3f34cc28-1748-4874-90fe-24420b4dd83c" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-3f34cc28-1748-4874-90fe-24420b4dd83c" acquired by "delete_volume" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:32 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c" returned: 0 in 0.496s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de2d3ad-0409-49a1-b58a-8b5b9a1f0faf]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:32 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:32 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 1G Aug 26 03:19:32 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:32 devstack sudo[114610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c Aug 26 03:19:32 devstack sudo[114610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[114610]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c" returned: 0 in 0.395s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 1G" returned: 0 in 0.425s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7974d10-ed23-4e8a-be9d-d5638701205c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack sudo[114620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c Aug 26 03:19:33 devstack sudo[114620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[114621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7974d10-ed23-4e8a-be9d-d5638701205c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 Aug 26 03:19:33 devstack sudo[114621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[114620]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-3f34cc28-1748-4874-90fe-24420b4dd83c" returned: 0 in 0.302s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-3f34cc28-1748-4874-90fe-24420b4dd83c" released by "delete_volume" :: held 0.760s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:33 devstack sudo[114621]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7974d10-ed23-4e8a-be9d-d5638701205c -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9" returned: 0 in 0.315s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 is being set with open permissions: ugo+rw Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 Aug 26 03:19:33 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Created reservations ['74fce073-8905-4227-8753-c8d6d1984337', '4b24ec63-dbce-44bf-b19c-259e56d7011c', '2caea40e-ab8d-48ae-8333-33452b899383', '45340bd9-eadc-4a50-8f1f-fb5c2c2665d4'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:33 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9" returned: 0 in 0.277s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.info Aug 26 03:19:33 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:34 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.303s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:34 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Deleted volume successfully. Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2899b812-7a1c-4685-a0bf-4f2d0e56b72d tempest-ProjectReaderTests-561634371 None] Lock "cinder-3f34cc28-1748-4874-90fe-24420b4dd83c-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:34 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.info" returned: 0 in 0.310s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:34 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.info is being set with open permissions: ugo+rw Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:34 devstack sudo[114637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.info Aug 26 03:19:34 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (89284db9-747b-4f4b-8b2b-a34a77ba2367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6593441f-a400-429d-8822-0ab485efe234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6593441f-a400-429d-8822-0ab485efe234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657178696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af70c728-7e34-4c11-a9ab-e27a64d2253a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:34Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5728cab-470e-4bc1-8f6e-29ae03318288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5728cab-470e-4bc1-8f6e-29ae03318288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46d1184-a624-42f1-a0a0-2d0a0c022c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46d1184-a624-42f1-a0a0-2d0a0c022c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af70c728-7e34-4c11-a9ab-e27a64d2253a', 'volume_name': 'volume-af70c728-7e34-4c11-a9ab-e27a64d2253a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceaa8fa6-214f-476e-be9a-1e8ae3f44bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceaa8fa6-214f-476e-be9a-1e8ae3f44bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcf41b6-6b47-47fa-a3f0-af0e813c5788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:34 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Volume af70c728-7e34-4c11-a9ab-e27a64d2253a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af70c728-7e34-4c11-a9ab-e27a64d2253a', 'volume_size': 1} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:34 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.info" returned: 0 in 0.294s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.791s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot 48a45836-ac11-451a-97a3-75ed27b0794f of volume 8ca2d666-a69f-4c60-bd7e-fe42d7d24834 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:34 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-16b6e38f-97ca-458e-b6d5-b44328f9076d tempest-SnapshotDependencyTests-182462297 None] Create snapshot completed successfully Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[979e72ba-b61b-4d93-b288-5285f0b12499]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:34 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 Aug 26 03:19:34 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:34 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" returned: 0 in 0.382s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:34 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:35 devstack sudo[114645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f 1G Aug 26 03:19:35 devstack sudo[114645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:35 devstack sudo[114645]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f 1G" returned: 0 in 0.428s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:35 devstack sudo[114650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f Aug 26 03:19:35 devstack sudo[114650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:35 devstack sudo[114650]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f" returned: 0 in 0.312s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:35 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f is being set with open permissions: ugo+rw Aug 26 03:19:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:35 devstack sudo[114655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f Aug 26 03:19:35 devstack sudo[114655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:35 devstack sudo[114655]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:35 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f" returned: 0 in 0.268s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:36 devstack sudo[114658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.info Aug 26 03:19:36 devstack sudo[114658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Flow 'volume_create_manager' (56fff754-aed8-49c1-bf22-741919ca7f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85869c41-e8cc-40a6-ac4b-013833a1f5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85869c41-e8cc-40a6-ac4b-013833a1f5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f96a24-9f2d-4812-9675-8d2b011b7483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f12bb5a57418babc6d69f6537c9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69e16bbc-4baa-4813-a8d6-5016cee249b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:36Z,use_quota=True,user_id='94492a3bd242441a934501bf82c1ebba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6801dc-6d82-41c7-b9d5-412f2d38e47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6801dc-6d82-41c7-b9d5-412f2d38e47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6648be-ef37-4bb1-8b50-d5d01a57611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6648be-ef37-4bb1-8b50-d5d01a57611a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e5f96a24-9f2d-4812-9675-8d2b011b7483', 'volume_name': 'volume-e5f96a24-9f2d-4812-9675-8d2b011b7483', 'volume_size': 1, 'snapshot_id': '69e16bbc-4baa-4813-a8d6-5016cee249b9'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e6ed98-1525-42be-9bcd-57f213d7905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e6ed98-1525-42be-9bcd-57f213d7905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9539b346-d546-4316-ad62-a1015d2c2cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Volume e5f96a24-9f2d-4812-9675-8d2b011b7483: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e5f96a24-9f2d-4812-9675-8d2b011b7483', 'volume_size': 1, 'snapshot_id': '69e16bbc-4baa-4813-a8d6-5016cee249b9'} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:36 devstack sudo[114658]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.info" returned: 0 in 0.293s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:36 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.info is being set with open permissions: ugo+rw Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:36 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.info Aug 26 03:19:36 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:36 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.info" returned: 0 in 0.262s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.067s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657178696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af70c728-7e34-4c11-a9ab-e27a64d2253a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:34Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Creating volume af70c728-7e34-4c11-a9ab-e27a64d2253a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:36 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:36 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:36 devstack sudo[114665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a 1073741824 Aug 26 03:19:36 devstack sudo[114665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:36 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9590a721-1f52-465f-aa7d-03eee6c8c3c5 tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-48a45836-ac11-451a-97a3-75ed27b0794f-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-48a45836-ac11-451a-97a3-75ed27b0794f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-48a45836-ac11-451a-97a3-75ed27b0794f" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-48a45836-ac11-451a-97a3-75ed27b0794f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot 48a45836-ac11-451a-97a3-75ed27b0794f of volume 8ca2d666-a69f-4c60-bd7e-fe42d7d24834 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed868688-1468-4f5b-8276-8d7986c1f965]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:37 devstack sudo[114665]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a 1073741824" returned: 0 in 0.529s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:37 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a Aug 26 03:19:37 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:37 devstack sudo[114671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f Aug 26 03:19:37 devstack sudo[114671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:37 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a" returned: 0 in 0.300s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.265s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-quobyte-69e16bbc-4baa-4813-a8d6-5016cee249b9-e5f96a24-9f2d-4812-9675-8d2b011b7483" by "_create_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcf41b6-6b47-47fa-a3f0-af0e813c5788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af70c728-7e34-4c11-a9ab-e27a64d2253a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cf32c8-67d5-4960-b4b1-a4761b64e127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:37 devstack sudo[114671]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f" returned: 0 in 0.437s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:37 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Volume volume-af70c728-7e34-4c11-a9ab-e27a64d2253a (af70c728-7e34-4c11-a9ab-e27a64d2253a): created successfully Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cf32c8-67d5-4960-b4b1-a4761b64e127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (89284db9-747b-4f4b-8b2b-a34a77ba2367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-69e16bbc-4baa-4813-a8d6-5016cee249b9-e5f96a24-9f2d-4812-9675-8d2b011b7483" acquired by "_create_volume_from_snapshot" :: waited 0.087s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Creating volume e5f96a24-9f2d-4812-9675-8d2b011b7483 from snapshot 69e16bbc-4baa-4813-a8d6-5016cee249b9 {{(pid=93797) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-quobyte-e5f96a24-9f2d-4812-9675-8d2b011b7483" by "_copy_volume_from_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[61539ba1-be2a-47a4-8dbe-a0f05da96857]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:37 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-3b122b00-f026-44c0-b52b-e1ec565a66a7 tempest-ProjectReaderTests-561634371 None] Created volume successfully. Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-e5f96a24-9f2d-4812-9675-8d2b011b7483" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] snapshot: 69e16bbc-4baa-4813-a8d6-5016cee249b9, volume: e5f96a24-9f2d-4812-9675-8d2b011b7483, {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[042afe3c-6225-4c7f-b809-cfbb63603355]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:37 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:37 devstack sudo[114679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 Aug 26 03:19:37 devstack sudo[114679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:37 devstack sudo[114680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 Aug 26 03:19:37 devstack sudo[114680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack sudo[114679]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" returned: 0 in 0.409s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:38 devstack sudo[114686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f Aug 26 03:19:38 devstack sudo[114686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack sudo[114680]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9" returned: 0 in 0.448s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7974d10-ed23-4e8a-be9d-d5638701205c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc81ce-e480-4d35-b3a1-913dc9dd1eac]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:38 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c Aug 26 03:19:38 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack sudo[114686]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f" returned: 0 in 0.396s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:38 devstack sudo[114696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f Aug 26 03:19:38 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c" returned: 0 in 0.424s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Creating direct copy from snapshot {{(pid=93797) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG cinder.utils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Path /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 not found in is_blk_device check {{(pid=93797) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:38 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 Aug 26 03:19:38 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834.48a45836-ac11-451a-97a3-75ed27b0794f" returned: 0 in 0.295s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-48a45836-ac11-451a-97a3-75ed27b0794f" released by "_delete_snapshot" :: held 1.674s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" released by "delete_snapshot" :: held 1.704s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Created reservations ['487f493b-0aa1-4e7e-bebf-bab06ec3e56a', '68f3e6ae-0387-41e4-bcd3-f2dfd3d4b153', '0da92222-cd3d-41e7-8b07-cc41b4720431', '45f638ce-d335-49ec-8b8d-821fd60ea1d7'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:38 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:19:38 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-9920f2a1-4d35-4453-a336-08ef642a2bf3 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-48a45836-ac11-451a-97a3-75ed27b0794f-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-8ca2d666-a69f-4c60-bd7e-fe42d7d24834-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-8ca2d666-a69f-4c60-bd7e-fe42d7d24834-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:39 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" acquired by "delete_volume" :: waited 0.049s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:39 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c1005-6c4a-4ed6-816e-0f0443e25a30]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:39 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:39 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 Aug 26 03:19:39 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:40 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" returned: 0 in 0.767s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:40 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:40 devstack sudo[114720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834 Aug 26 03:19:40 devstack sudo[114720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:41 devstack sudo[114720]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" returned: 0 in 0.751s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-8ca2d666-a69f-4c60-bd7e-fe42d7d24834" released by "delete_volume" :: held 1.695s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=183,cinder:INSERT=62,cinder:UPDATE=237,cinder:DELETE=16 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:INSERT=60,cinder:UPDATE=228,cinder:SELECT=168,cinder:DELETE=23 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Created reservations ['5037c136-d359-40e3-9cfd-5d10d1f56a20', '8dcb1911-9e98-4377-9e2e-5e241288785a', '1730b39c-2eb7-4206-94c7-cc6cf91998ed', 'd2c768f5-4af4-4e4f-bb0c-6b26fe0c4563'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:41 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:41 devstack sudo[114723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:41 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:42 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:42 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.555s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:42 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:42 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:19:42 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-e23f75b8-0848-4b60-981c-e3b911225bc8 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-8ca2d666-a69f-4c60-bd7e-fe42d7d24834-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:42 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (f4b55311-850b-4446-aa89-b1c93c694184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf946499-a7e6-47f8-b600-bce972b55caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf946499-a7e6-47f8-b600-bce972b55caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693781499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6200a5f2-7632-4577-963f-2ee19489dfe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:43Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb95423-5144-4e4f-ab1f-e693d970299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb95423-5144-4e4f-ab1f-e693d970299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05518441-14ec-4c91-a7db-66d294ebcd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05518441-14ec-4c91-a7db-66d294ebcd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6200a5f2-7632-4577-963f-2ee19489dfe2', 'volume_name': 'volume-6200a5f2-7632-4577-963f-2ee19489dfe2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896115e3-717e-4e68-b1f2-ea03ba2998cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896115e3-717e-4e68-b1f2-ea03ba2998cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7441870-bc22-49fc-b92d-30431468c706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:43 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Volume 6200a5f2-7632-4577-963f-2ee19489dfe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6200a5f2-7632-4577-963f-2ee19489dfe2', 'volume_size': 1} Aug 26 03:19:43 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:44 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483" returned: 0 in 5.464s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG cinder.image.image_utils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Image conversion details: src /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 {{(pid=93797) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:19:44 devstack cinder-volume[93797]: INFO cinder.image.image_utils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Converted 1024.00 MB image at 187.38 MB/s Aug 26 03:19:44 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 is being set with open permissions: ugo+rw Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:44 devstack sudo[114729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 Aug 26 03:19:44 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:44 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483" returned: 0 in 0.260s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-e5f96a24-9f2d-4812-9675-8d2b011b7483" released by "_copy_volume_from_snapshot" :: held 6.693s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-69e16bbc-4baa-4813-a8d6-5016cee249b9-e5f96a24-9f2d-4812-9675-8d2b011b7483" released by "_create_volume_from_snapshot" :: held 6.779s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.868s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.423s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Creating offline snapshot 1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 of volume af70c728-7e34-4c11-a9ab-e27a64d2253a {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9539b346-d546-4316-ad62-a1015d2c2cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f96a24-9f2d-4812-9675-8d2b011b7483', 'volume_size': 1, 'snapshot_id': '69e16bbc-4baa-4813-a8d6-5016cee249b9'}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8697a799-48dc-4a63-a7e0-404df5080104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da27a75-4df9-41c9-8d9d-f0a634461ff4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:44 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Volume volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 (e5f96a24-9f2d-4812-9675-8d2b011b7483): created successfully Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8697a799-48dc-4a63-a7e0-404df5080104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Flow 'volume_create_manager' (56fff754-aed8-49c1-bf22-741919ca7f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:44 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6f71713a-f01a-495b-988a-d2080265f581 tempest-SnapshotDependencyTests-182462297 None] Created volume successfully. Aug 26 03:19:44 devstack sudo[114732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a Aug 26 03:19:44 devstack sudo[114732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:44 devstack sudo[114732]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a" returned: 0 in 0.383s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:44 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:44 devstack sudo[114737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 1G Aug 26 03:19:44 devstack sudo[114737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:45 devstack sudo[114737]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 1G" returned: 0 in 0.424s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af70c728-7e34-4c11-a9ab-e27a64d2253a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:45 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af70c728-7e34-4c11-a9ab-e27a64d2253a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 Aug 26 03:19:45 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-69e16bbc-4baa-4813-a8d6-5016cee249b9-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-69e16bbc-4baa-4813-a8d6-5016cee249b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-quobyte-c7974d10-ed23-4e8a-be9d-d5638701205c" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-c7974d10-ed23-4e8a-be9d-d5638701205c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-quobyte-69e16bbc-4baa-4813-a8d6-5016cee249b9" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-69e16bbc-4baa-4813-a8d6-5016cee249b9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Deleting offline snapshot 69e16bbc-4baa-4813-a8d6-5016cee249b9 of volume c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] snapshot_file for this snap is: volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8203f-b87f-42d7-ace1-a380427e9660]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:45 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:45 devstack sudo[114745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 Aug 26 03:19:45 devstack sudo[114745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af70c728-7e34-4c11-a9ab-e27a64d2253a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0" returned: 0 in 0.350s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:45 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 is being set with open permissions: ugo+rw Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:45 devstack sudo[114750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 Aug 26 03:19:45 devstack sudo[114750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:45 devstack sudo[114750]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0" returned: 0 in 0.278s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:45 devstack sudo[114745]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9" returned: 0 in 0.426s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7974d10-ed23-4e8a-be9d-d5638701205c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0b7fcc-8863-4431-ac70-ef1d066f93c1]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:45 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:45 devstack sudo[114756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.info Aug 26 03:19:45 devstack sudo[114756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c Aug 26 03:19:46 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack sudo[114756]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.info" returned: 0 in 0.261s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:46 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.info is being set with open permissions: ugo+rw Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:46 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.info Aug 26 03:19:46 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.info" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.074s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:46 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693781499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6200a5f2-7632-4577-963f-2ee19489dfe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:43Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Creating volume 6200a5f2-7632-4577-963f-2ee19489dfe2 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:46 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c" returned: 0 in 0.600s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:46 devstack sudo[114768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 1073741824 Aug 26 03:19:46 devstack sudo[114768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack sudo[114769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 Aug 26 03:19:46 devstack sudo[114769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-25a76d99-beac-46f1-8aea-9bcc7e7c9b1c tempest-ProjectReaderTests-561634371 None] Create snapshot completed successfully Aug 26 03:19:46 devstack sudo[114769]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9" returned: 0 in 0.382s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:46 devstack sudo[114779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9 Aug 26 03:19:46 devstack sudo[114779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack sudo[114768]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 1073741824" returned: 0 in 0.459s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:46 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:47 devstack sudo[114781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 Aug 26 03:19:47 devstack sudo[114781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:47 devstack sudo[114779]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c.69e16bbc-4baa-4813-a8d6-5016cee249b9" returned: 0 in 0.285s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-69e16bbc-4baa-4813-a8d6-5016cee249b9" released by "_delete_snapshot" :: held 1.827s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-c7974d10-ed23-4e8a-be9d-d5638701205c" released by "delete_snapshot" :: held 1.861s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:47 devstack sudo[114781]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2" returned: 0 in 0.325s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7441870-bc22-49fc-b92d-30431468c706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6200a5f2-7632-4577-963f-2ee19489dfe2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433d5728-f138-4dc2-8a72-960c7887cb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Created reservations ['fe8fc5ef-2ce1-4a06-b748-88c3a1fefa75', '25b6660f-203b-43d3-8dd3-637e16dfc207', 'f7686e60-e2c5-4caf-b5fd-287a198a7ea7', '45610390-746a-493d-8293-30bdda328fef'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:47 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Volume volume-6200a5f2-7632-4577-963f-2ee19489dfe2 (6200a5f2-7632-4577-963f-2ee19489dfe2): created successfully Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433d5728-f138-4dc2-8a72-960c7887cb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (f4b55311-850b-4446-aa89-b1c93c694184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:47 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-94c5ba57-c8a3-4a84-b0e2-7014952c2980 tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:19:47 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Delete snapshot completed successfully. Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-dc7e5485-6a2b-4c95-b10f-b2bb579652f3 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-69e16bbc-4baa-4813-a8d6-5016cee249b9-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-c7974d10-ed23-4e8a-be9d-d5638701205c-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-c7974d10-ed23-4e8a-be9d-d5638701205c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-1b8b5e54-30b3-4d0e-a291-0ff1395f92d0-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-quobyte-c7974d10-ed23-4e8a-be9d-d5638701205c" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Lock "cinder-1b8b5e54-30b3-4d0e-a291-0ff1395f92d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.118s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-af70c728-7e34-4c11-a9ab-e27a64d2253a" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-af70c728-7e34-4c11-a9ab-e27a64d2253a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-1b8b5e54-30b3-4d0e-a291-0ff1395f92d0" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-c7974d10-ed23-4e8a-be9d-d5638701205c" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd8e49e-64ab-452b-9eb4-46e75a338ee8]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-1b8b5e54-30b3-4d0e-a291-0ff1395f92d0" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Deleting offline snapshot 1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 of volume af70c728-7e34-4c11-a9ab-e27a64d2253a {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] snapshot_file for this snap is: volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e1914b-b883-4ecc-aa69-9643537c67c0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:47 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:47 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c Aug 26 03:19:47 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 Aug 26 03:19:48 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c" returned: 0 in 0.435s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:48 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c Aug 26 03:19:48 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:48 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot bda9a28b-8b19-4f45-90be-8f547fcbcaf2 of volume 6200a5f2-7632-4577-963f-2ee19489dfe2 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0" returned: 0 in 0.507s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af70c728-7e34-4c11-a9ab-e27a64d2253a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[5975b685-01f9-4706-b591-8402e7708b01]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[7171a9bb-3e8f-4fdd-8c45-e4c7bb7c7e78]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:48 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 Aug 26 03:19:48 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[114800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a Aug 26 03:19:48 devstack sudo[114800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-c7974d10-ed23-4e8a-be9d-d5638701205c" returned: 0 in 0.346s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-c7974d10-ed23-4e8a-be9d-d5638701205c" released by "delete_volume" :: held 0.876s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Created reservations ['2caa7a6a-1fec-47ff-bcb1-c61bf6fb38d8', '1220c428-6262-44ba-a66b-9d7b113c40ce', '76630685-09f2-4f06-a24f-941754157f62', '14847c21-686a-4e76-b8c7-88b53a96c790'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:48 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:48 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[114800]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a" returned: 0 in 0.447s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:48 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 Aug 26 03:19:48 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2" returned: 0 in 0.580s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:48 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:49 devstack sudo[114814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 1G Aug 26 03:19:49 devstack sudo[114814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:49 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.311s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-e5f96a24-9f2d-4812-9675-8d2b011b7483-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Deleted volume successfully. Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-e5f96a24-9f2d-4812-9675-8d2b011b7483-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0e50e68d-c82a-4e32-b077-7e0e5875487d tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-c7974d10-ed23-4e8a-be9d-d5638701205c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "cinder-quobyte-e5f96a24-9f2d-4812-9675-8d2b011b7483" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-e5f96a24-9f2d-4812-9675-8d2b011b7483" acquired by "delete_volume" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b75ddc-2eb8-4b22-9583-62f8912ace18]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:49 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0" returned: 0 in 0.475s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:49 devstack sudo[114824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0 Aug 26 03:19:49 devstack sudo[114824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:49 devstack sudo[114821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 Aug 26 03:19:49 devstack sudo[114821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:49 devstack sudo[114814]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 1G" returned: 0 in 0.527s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6200a5f2-7632-4577-963f-2ee19489dfe2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:49 devstack sudo[114827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6200a5f2-7632-4577-963f-2ee19489dfe2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 Aug 26 03:19:49 devstack sudo[114827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:49 devstack sudo[114824]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a.1b8b5e54-30b3-4d0e-a291-0ff1395f92d0" returned: 0 in 0.288s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-1b8b5e54-30b3-4d0e-a291-0ff1395f92d0" released by "_delete_snapshot" :: held 1.829s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-af70c728-7e34-4c11-a9ab-e27a64d2253a" released by "delete_snapshot" :: held 1.913s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:49 devstack sudo[114821]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483" returned: 0 in 0.445s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:49 devstack sudo[114833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483 Aug 26 03:19:49 devstack sudo[114833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Created reservations ['cc56c06f-c26f-4ced-b785-4908de987cbf', 'fdef5635-7428-45b8-bf01-1ac9476e0bd7', '2db440f2-7ff0-4a54-a1df-1819b8dfe98c', '54832e2e-a856-4b2b-8766-bbe55f8f4c15'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:49 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Delete snapshot completed successfully. Aug 26 03:19:49 devstack sudo[114827]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6200a5f2-7632-4577-963f-2ee19489dfe2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2" returned: 0 in 0.361s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:49 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 is being set with open permissions: ugo+rw Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:49 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-0da0067a-7f9c-4b2a-9267-f8d4f7f150c3 tempest-ProjectReaderTests-561634371 None] Lock "cinder-1b8b5e54-30b3-4d0e-a291-0ff1395f92d0-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:49 devstack sudo[114839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 Aug 26 03:19:49 devstack sudo[114839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:50 devstack sudo[114833]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-e5f96a24-9f2d-4812-9675-8d2b011b7483" returned: 0 in 0.315s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-quobyte-e5f96a24-9f2d-4812-9675-8d2b011b7483" released by "delete_volume" :: held 0.807s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Created reservations ['9925b930-98c9-4156-ab7e-85bcba4ae665', 'aadc7a71-f6ca-4abc-953b-4e2d5df5ab30', '5f886912-ac17-4e9e-89a5-a6f2eb251f9a', 'c11a8918-224a-4841-81f6-a60510f49a5e'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:50 devstack sudo[114839]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2" returned: 0 in 0.283s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:50 devstack sudo[114843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:50 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:50 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.info Aug 26 03:19:50 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:50 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.284s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Deleted volume successfully. Aug 26 03:19:50 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-a2b048e1-5e15-45dd-b4b8-32d953f71c27 tempest-SnapshotDependencyTests-182462297 None] Lock "cinder-e5f96a24-9f2d-4812-9675-8d2b011b7483-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.info" returned: 0 in 0.313s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:50 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.info is being set with open permissions: ugo+rw Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:50 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.info Aug 26 03:19:50 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:50 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.info" returned: 0 in 0.286s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:50 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-800dc4e1-46e4-4023-977f-7b125ad3c73f tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-af70c728-7e34-4c11-a9ab-e27a64d2253a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:50 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Lock "cinder-af70c728-7e34-4c11-a9ab-e27a64d2253a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-af70c728-7e34-4c11-a9ab-e27a64d2253a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-af70c728-7e34-4c11-a9ab-e27a64d2253a" acquired by "delete_volume" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[78611c76-48ac-45b1-956d-98b3b234435a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:51 devstack sudo[114852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a Aug 26 03:19:51 devstack sudo[114852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-bda9a28b-8b19-4f45-90be-8f547fcbcaf2-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:51 devstack sudo[114852]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a" returned: 0 in 0.488s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-bda9a28b-8b19-4f45-90be-8f547fcbcaf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-6200a5f2-7632-4577-963f-2ee19489dfe2" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:51 devstack sudo[114858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a Aug 26 03:19:51 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6200a5f2-7632-4577-963f-2ee19489dfe2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-bda9a28b-8b19-4f45-90be-8f547fcbcaf2" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-bda9a28b-8b19-4f45-90be-8f547fcbcaf2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot bda9a28b-8b19-4f45-90be-8f547fcbcaf2 of volume 6200a5f2-7632-4577-963f-2ee19489dfe2 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f4c97-d4a3-476a-a4a1-18fdb18c4c02]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:51 devstack sudo[114860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 Aug 26 03:19:51 devstack sudo[114860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:51 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-af70c728-7e34-4c11-a9ab-e27a64d2253a" returned: 0 in 0.298s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-af70c728-7e34-4c11-a9ab-e27a64d2253a" released by "delete_volume" :: held 0.861s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:51 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Created reservations ['b46cb4ad-ac84-4729-b9bb-ae40b627bc2a', 'a1e39fe8-7320-443c-9181-8127731eea32', '0692936c-debb-4fc6-8ef1-67594072474a', '455542a4-2d11-4a07-aafd-b8ee4bc04041'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:52 devstack sudo[114865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:52 devstack sudo[114865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:52 devstack sudo[114860]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2" returned: 0 in 0.480s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6200a5f2-7632-4577-963f-2ee19489dfe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[2962c2ac-b664-4076-9556-40b06159d3be]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:52 devstack sudo[114869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 Aug 26 03:19:52 devstack sudo[114869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:52 devstack sudo[114865]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.364s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:52 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Deleted volume successfully. Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-8edf8432-310b-4ac4-9c76-0328e603d1de tempest-ProjectReaderTests-561634371 None] Lock "cinder-af70c728-7e34-4c11-a9ab-e27a64d2253a-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:52 devstack sudo[114869]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2" returned: 0 in 0.500s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:52 devstack sudo[114875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 Aug 26 03:19:52 devstack sudo[114875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (7bc73bb5-48c2-425a-9994-4dc2de324b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de21da6-6d84-49fe-87f9-c76f662c9cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de21da6-6d84-49fe-87f9-c76f662c9cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1680202942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e06836e-9b78-416c-bc0f-5fe470346e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:53Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33445e0f-9c29-4ffe-8c54-541ea03962d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33445e0f-9c29-4ffe-8c54-541ea03962d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adee860-fda7-4b7e-8eef-253b7a4c0f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adee860-fda7-4b7e-8eef-253b7a4c0f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e06836e-9b78-416c-bc0f-5fe470346e53', 'volume_name': 'volume-0e06836e-9b78-416c-bc0f-5fe470346e53', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f61e2f-5349-41c6-af1a-ecb7cbc2a77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f61e2f-5349-41c6-af1a-ecb7cbc2a77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e715b4-5cd9-48b4-a13d-c5c77f93365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:52 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Volume 0e06836e-9b78-416c-bc0f-5fe470346e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e06836e-9b78-416c-bc0f-5fe470346e53', 'volume_size': 1} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1680202942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e06836e-9b78-416c-bc0f-5fe470346e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d409174257d54313931be4750a57e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:53Z,use_quota=True,user_id='3b21b50298be419a9f035f83d1c9e05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Creating volume 0e06836e-9b78-416c-bc0f-5fe470346e53 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:52 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:52 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:52 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 1073741824 Aug 26 03:19:52 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:53 devstack sudo[114875]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2" returned: 0 in 0.416s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:53 devstack sudo[114883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2 Aug 26 03:19:53 devstack sudo[114883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:53 devstack sudo[114883]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2.bda9a28b-8b19-4f45-90be-8f547fcbcaf2" returned: 0 in 0.309s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-bda9a28b-8b19-4f45-90be-8f547fcbcaf2" released by "_delete_snapshot" :: held 1.839s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:53 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6200a5f2-7632-4577-963f-2ee19489dfe2" released by "delete_snapshot" :: held 1.871s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:53 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 1073741824" returned: 0 in 0.616s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:53 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Created reservations ['1a654ae8-c8cf-44d9-9a5a-8efe5d9b6b57', '3e75ae49-a58f-427e-9d92-bac2e917f601', '30b587bd-92d7-4eed-93ae-1ab967cd76fc', '1daf3b9a-0bb2-4c73-813e-35038bdc4d8f'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:53 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:53 devstack sudo[114890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 Aug 26 03:19:53 devstack sudo[114890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:19:54 devstack sudo[114890]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-c429c227-a0ae-4de1-9800-e24948b1f74e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-bda9a28b-8b19-4f45-90be-8f547fcbcaf2-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53" returned: 0 in 0.278s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e715b4-5cd9-48b4-a13d-c5c77f93365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e06836e-9b78-416c-bc0f-5fe470346e53', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47abd914-4115-48b9-8c9b-3a0856db5be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:54 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Volume volume-0e06836e-9b78-416c-bc0f-5fe470346e53 (0e06836e-9b78-416c-bc0f-5fe470346e53): created successfully Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47abd914-4115-48b9-8c9b-3a0856db5be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Flow 'volume_create_manager' (7bc73bb5-48c2-425a-9994-4dc2de324b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:54 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-a4a0526a-7428-4169-a0ec-850842210f82 tempest-ProjectReaderTests-561634371 None] Created volume successfully. Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-6200a5f2-7632-4577-963f-2ee19489dfe2-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-6200a5f2-7632-4577-963f-2ee19489dfe2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-6200a5f2-7632-4577-963f-2ee19489dfe2" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6200a5f2-7632-4577-963f-2ee19489dfe2" acquired by "delete_volume" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[881ee5ce-79f4-442e-955e-c1f4056e2cee]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:54 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:55 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 Aug 26 03:19:55 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Creating offline snapshot 605be905-1492-4150-b08f-b3942e5c1050 of volume 0e06836e-9b78-416c-bc0f-5fe470346e53 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1398f4e9-bbe3-459e-b51d-a30affaace87]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:55 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 Aug 26 03:19:55 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:55 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2" returned: 0 in 0.455s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:55 devstack sudo[114900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2 Aug 26 03:19:55 devstack sudo[114900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:55 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53" returned: 0 in 0.508s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:55 devstack sudo[114905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 1G Aug 26 03:19:55 devstack sudo[114905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:55 devstack sudo[114900]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6200a5f2-7632-4577-963f-2ee19489dfe2" returned: 0 in 0.361s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6200a5f2-7632-4577-963f-2ee19489dfe2" released by "delete_volume" :: held 0.894s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Created reservations ['3e92405b-f359-4b76-b84b-844455b4f0fa', '7ea9e68e-d9e8-4cef-8435-508ba69f46a0', '33c594a3-bd0e-4031-a4da-936012d07be4', '058cc262-1e2c-4614-b60b-99c3745e5712'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:55 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:56 devstack sudo[114911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:19:56 devstack sudo[114911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:56 devstack sudo[114905]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 1G" returned: 0 in 0.574s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e06836e-9b78-416c-bc0f-5fe470346e53 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:56 devstack sudo[114911]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:56 devstack sudo[114915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e06836e-9b78-416c-bc0f-5fe470346e53 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.295s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:56 devstack sudo[114915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:56 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-32795d3b-cea0-46f8-8833-8ee37c772b83 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-6200a5f2-7632-4577-963f-2ee19489dfe2-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:56 devstack sudo[114915]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (ce58ea0d-6169-4d22-a89c-6f5d003db373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b048c737-1faa-462b-a8e2-22d7ac86d193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e06836e-9b78-416c-bc0f-5fe470346e53 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050" returned: 0 in 0.520s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:56 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 is being set with open permissions: ugo+rw Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b048c737-1faa-462b-a8e2-22d7ac86d193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487123418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444224a1-8e50-4270-83d4-e188a49c4d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:57Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:56 devstack sudo[114923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 Aug 26 03:19:56 devstack sudo[114923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f0372d-5a31-43f3-b3d4-db85c914dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f0372d-5a31-43f3-b3d4-db85c914dedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c063dcd-61f9-4c09-87cd-6025815e6943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c063dcd-61f9-4c09-87cd-6025815e6943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444224a1-8e50-4270-83d4-e188a49c4d8f', 'volume_name': 'volume-444224a1-8e50-4270-83d4-e188a49c4d8f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca83f2ab-08a2-4c13-9a51-ecab83dcc939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca83f2ab-08a2-4c13-9a51-ecab83dcc939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dcb9a5c-8c06-4dc4-9c87-55b226509641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:56 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Volume 444224a1-8e50-4270-83d4-e188a49c4d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444224a1-8e50-4270-83d4-e188a49c4d8f', 'volume_size': 1} Aug 26 03:19:56 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:57 devstack sudo[114923]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050" returned: 0 in 0.319s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:57 devstack sudo[114960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.info Aug 26 03:19:57 devstack sudo[114960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:57 devstack sudo[114960]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.info" returned: 0 in 0.348s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:57 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.info is being set with open permissions: ugo+rw Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:57 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.info Aug 26 03:19:57 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:57 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.info" returned: 0 in 0.285s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487123418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444224a1-8e50-4270-83d4-e188a49c4d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:57Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Creating volume 444224a1-8e50-4270-83d4-e188a49c4d8f {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:57 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:19:57 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:57 devstack sudo[114968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f 1073741824 Aug 26 03:19:57 devstack sudo[114968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:57 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d333b219-80c2-4e37-b04a-42477d91c2cb tempest-ProjectReaderTests-561634371 None] Create snapshot completed successfully Aug 26 03:19:58 devstack sudo[114968]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f 1073741824" returned: 0 in 0.529s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-605be905-1492-4150-b08f-b3942e5c1050-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Lock "cinder-605be905-1492-4150-b08f-b3942e5c1050-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-0e06836e-9b78-416c-bc0f-5fe470346e53" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:58 devstack sudo[114974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f Aug 26 03:19:58 devstack sudo[114974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-0e06836e-9b78-416c-bc0f-5fe470346e53" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-605be905-1492-4150-b08f-b3942e5c1050" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-605be905-1492-4150-b08f-b3942e5c1050" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Deleting offline snapshot 605be905-1492-4150-b08f-b3942e5c1050 of volume 0e06836e-9b78-416c-bc0f-5fe470346e53 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] snapshot_file for this snap is: volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c240e2ac-b8a3-4a04-a23f-7be2951e63c0]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:58 devstack sudo[114976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 Aug 26 03:19:58 devstack sudo[114976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:58 devstack sudo[114974]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f" returned: 0 in 0.325s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dcb9a5c-8c06-4dc4-9c87-55b226509641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444224a1-8e50-4270-83d4-e188a49c4d8f', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b631c89-7e4f-43d8-ace6-d3c193d8fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:58 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Volume volume-444224a1-8e50-4270-83d4-e188a49c4d8f (444224a1-8e50-4270-83d4-e188a49c4d8f): created successfully Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b631c89-7e4f-43d8-ace6-d3c193d8fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (ce58ea0d-6169-4d22-a89c-6f5d003db373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:58 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-bf6ef478-0724-4a4c-bfc3-bb3601dff1d7 tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:19:58 devstack sudo[114976]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050" returned: 0 in 0.498s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:58 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e06836e-9b78-416c-bc0f-5fe470346e53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:59 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbcc0cd-e69d-4dd3-9a13-2dfe1c6ec5f5]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:59 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 Aug 26 03:19:59 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:59 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53" returned: 0 in 0.409s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:59 devstack sudo[114988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 Aug 26 03:19:59 devstack sudo[114988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:59 devstack sudo[114988]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050" returned: 0 in 0.415s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:59 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:59 devstack sudo[114994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050 Aug 26 03:19:59 devstack sudo[114994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:00 devstack sudo[114994]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot 899bd135-3638-4bc3-a604-1d69f46f4fcc of volume 444224a1-8e50-4270-83d4-e188a49c4d8f {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53.605be905-1492-4150-b08f-b3942e5c1050" returned: 0 in 0.288s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[108d2daa-0673-48eb-ade4-9ad882de5673]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-605be905-1492-4150-b08f-b3942e5c1050" released by "_delete_snapshot" :: held 1.740s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-0e06836e-9b78-416c-bc0f-5fe470346e53" released by "delete_snapshot" :: held 1.770s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Created reservations ['93dec085-71f3-4b01-b163-880240ad0a29', '33584074-2465-46bf-9f68-434793bfb729', 'b3089c0b-5a6b-42c2-82f4-f856fe254b68', '7f39001c-ff0f-45f6-9579-1b9a51ea555d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:00 devstack sudo[115003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f Aug 26 03:20:00 devstack sudo[115003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:00 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Delete snapshot completed successfully. Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-11647195-5780-4535-a480-774afb5fe411 tempest-ProjectReaderTests-561634371 None] Lock "cinder-605be905-1492-4150-b08f-b3942e5c1050-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-0e06836e-9b78-416c-bc0f-5fe470346e53-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:00 devstack sudo[115003]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f" returned: 0 in 0.385s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Lock "cinder-0e06836e-9b78-416c-bc0f-5fe470346e53-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:00 devstack sudo[115008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc 1G Aug 26 03:20:00 devstack sudo[115008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Acquiring lock "cinder-quobyte-0e06836e-9b78-416c-bc0f-5fe470346e53" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-0e06836e-9b78-416c-bc0f-5fe470346e53" acquired by "delete_volume" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2723ad-80e8-4686-9dc6-b44d4ba24ccb]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:00 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:00 devstack sudo[115010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 Aug 26 03:20:00 devstack sudo[115010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:01 devstack sudo[115008]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc 1G" returned: 0 in 0.584s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444224a1-8e50-4270-83d4-e188a49c4d8f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:01 devstack sudo[115017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444224a1-8e50-4270-83d4-e188a49c4d8f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc Aug 26 03:20:01 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:01 devstack sudo[115010]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53" returned: 0 in 0.521s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:01 devstack sudo[115021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53 Aug 26 03:20:01 devstack sudo[115021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:01 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444224a1-8e50-4270-83d4-e188a49c4d8f -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc" returned: 0 in 0.346s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:01 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc is being set with open permissions: ugo+rw Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:01 devstack sudo[115026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc Aug 26 03:20:01 devstack sudo[115026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:01 devstack sudo[115021]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-0e06836e-9b78-416c-bc0f-5fe470346e53" returned: 0 in 0.318s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Lock "cinder-quobyte-0e06836e-9b78-416c-bc0f-5fe470346e53" released by "delete_volume" :: held 0.931s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Created reservations ['d0483f56-f443-43d9-8415-96d2f52c312b', '195b6f38-379b-46ec-83a0-6c33fc06e15d', '6c1310be-67fc-4d5f-920b-8ed47947d72e', '8ee15b90-502b-427a-bfe5-0dd70aa7e441'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:01 devstack sudo[115030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:20:01 devstack sudo[115030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:01 devstack sudo[115026]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc" returned: 0 in 0.334s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:01 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:01 devstack sudo[115032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.info Aug 26 03:20:01 devstack sudo[115032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:02 devstack sudo[115030]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.318s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:02 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Deleted volume successfully. Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-5462c247-2115-41cc-aa02-611121931322 tempest-ProjectReaderTests-561634371 None] Lock "cinder-0e06836e-9b78-416c-bc0f-5fe470346e53-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:02 devstack sudo[115036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:20:02 devstack sudo[115036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:02 devstack sudo[115032]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.info" returned: 0 in 0.332s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:02 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.info is being set with open permissions: ugo+rw Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:02 devstack sudo[115039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.info Aug 26 03:20:02 devstack sudo[115039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:02 devstack sudo[115036]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.299s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_service.periodic_task [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] Running periodic task VolumeManager._thread_info {{(pid=93797) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread count: 28 {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-07622ee3-00f4-4d92-a09c-cc11cb991012 None None] thread info: [<_MainThread(MainThread, started 129863971451008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93797) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:20:02 devstack sudo[115039]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.info" returned: 0 in 0.319s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:02 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:02 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6164e3be-c42f-4b2e-8b2b-542b856c29c1 tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-899bd135-3638-4bc3-a604-1d69f46f4fcc-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-899bd135-3638-4bc3-a604-1d69f46f4fcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-444224a1-8e50-4270-83d4-e188a49c4d8f" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-444224a1-8e50-4270-83d4-e188a49c4d8f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-899bd135-3638-4bc3-a604-1d69f46f4fcc" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-899bd135-3638-4bc3-a604-1d69f46f4fcc" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot 899bd135-3638-4bc3-a604-1d69f46f4fcc of volume 444224a1-8e50-4270-83d4-e188a49c4d8f {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf31fec-7086-4a94-bace-2fa3bfa78652]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:03 devstack sudo[115043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc Aug 26 03:20:03 devstack sudo[115043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:03 devstack sudo[115043]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc" returned: 0 in 0.469s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:03 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444224a1-8e50-4270-83d4-e188a49c4d8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:20:04 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4f0c00-0cb0-4f11-a477-9da1e3eb782a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:04 devstack sudo[115048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f Aug 26 03:20:04 devstack sudo[115048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:04 devstack sudo[115048]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f" returned: 0 in 0.482s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:04 devstack sudo[115054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc Aug 26 03:20:04 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:04 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc" returned: 0 in 0.382s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:04 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:04 devstack sudo[115059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc Aug 26 03:20:04 devstack sudo[115059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:05 devstack sudo[115059]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f.899bd135-3638-4bc3-a604-1d69f46f4fcc" returned: 0 in 0.261s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-899bd135-3638-4bc3-a604-1d69f46f4fcc" released by "_delete_snapshot" :: held 1.751s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-444224a1-8e50-4270-83d4-e188a49c4d8f" released by "delete_snapshot" :: held 1.793s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Created reservations ['59bb3ea9-139a-45e5-b3bf-c3d23b958855', 'af7b032e-c984-4b6d-ab1c-730492d6ba2d', '8392c760-4fa0-431a-b303-432791b74e68', '76d03db6-e422-4d3c-8f2a-425689361e0b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:05 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-905eb326-b8c3-45ef-90f8-75209116bea4 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-899bd135-3638-4bc3-a604-1d69f46f4fcc-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-444224a1-8e50-4270-83d4-e188a49c4d8f-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-444224a1-8e50-4270-83d4-e188a49c4d8f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-444224a1-8e50-4270-83d4-e188a49c4d8f" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-444224a1-8e50-4270-83d4-e188a49c4d8f" acquired by "delete_volume" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[f315d289-4e5b-4c27-a90a-143ed2f48ec8]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:05 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:05 devstack sudo[115062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f Aug 26 03:20:05 devstack sudo[115062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:06 devstack sudo[115062]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f" returned: 0 in 0.367s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:06 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f Aug 26 03:20:06 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:06 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-444224a1-8e50-4270-83d4-e188a49c4d8f" returned: 0 in 0.257s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-444224a1-8e50-4270-83d4-e188a49c4d8f" released by "delete_volume" :: held 0.681s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Created reservations ['e62c6cfa-4300-4f4b-a739-cc6c84d09088', 'f0a025a4-eecd-4512-97ae-8bae91de6eb6', '4dd300a1-60c3-41af-830b-5a919c9cfeb0', 'd80c2abd-d925-4574-8728-c77d246cc881'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:06 devstack sudo[115071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:20:06 devstack sudo[115071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:06 devstack sudo[115071]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.263s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:06 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:20:06 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-2293a1f1-4d49-4c88-9196-8e56d87ffe51 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-444224a1-8e50-4270-83d4-e188a49c4d8f-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (82f1d312-1465-4ec7-ae18-2f64bc85b62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f434ede4-2916-4431-90dd-a4bc9a2bdc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f434ede4-2916-4431-90dd-a4bc9a2bdc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802664770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315a3752-aca0-4e0a-b75c-21645da26a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:07Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d6748e-3bd2-441a-88de-dae1e999f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d6748e-3bd2-441a-88de-dae1e999f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5406c6-e8a0-4ce7-b620-70297d7cc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5406c6-e8a0-4ce7-b620-70297d7cc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315a3752-aca0-4e0a-b75c-21645da26a0a', 'volume_name': 'volume-315a3752-aca0-4e0a-b75c-21645da26a0a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97746cad-1707-47c0-8d79-65f6e1037e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97746cad-1707-47c0-8d79-65f6e1037e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170dd46b-71c2-4c99-b771-216c3898f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:07 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Volume 315a3752-aca0-4e0a-b75c-21645da26a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315a3752-aca0-4e0a-b75c-21645da26a0a', 'volume_size': 1} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802664770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315a3752-aca0-4e0a-b75c-21645da26a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:07Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Creating volume 315a3752-aca0-4e0a-b75c-21645da26a0a {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:07 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:07 devstack sudo[115074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a 1073741824 Aug 26 03:20:07 devstack sudo[115074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:07 devstack sudo[115074]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a 1073741824" returned: 0 in 0.439s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:07 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:07 devstack sudo[115079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a Aug 26 03:20:07 devstack sudo[115079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:08 devstack sudo[115079]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a" returned: 0 in 0.258s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170dd46b-71c2-4c99-b771-216c3898f3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315a3752-aca0-4e0a-b75c-21645da26a0a', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc85beac-2f2c-4d97-8650-6f41eee81f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:08 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Volume volume-315a3752-aca0-4e0a-b75c-21645da26a0a (315a3752-aca0-4e0a-b75c-21645da26a0a): created successfully Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc85beac-2f2c-4d97-8650-6f41eee81f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (82f1d312-1465-4ec7-ae18-2f64bc85b62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:08 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-542f9df9-a9b3-4c8c-96c9-6e82460eb565 tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot 48fc4b80-2116-4c3b-b266-c279655a8484 of volume 315a3752-aca0-4e0a-b75c-21645da26a0a {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad512d0-1ea8-40d6-b8d9-f467cc9d29ae]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:08 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a Aug 26 03:20:08 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:08 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a" returned: 0 in 0.389s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:08 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:08 devstack sudo[115087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 1G Aug 26 03:20:08 devstack sudo[115087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:09 devstack sudo[115087]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 1G" returned: 0 in 0.399s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315a3752-aca0-4e0a-b75c-21645da26a0a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:09 devstack sudo[115092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315a3752-aca0-4e0a-b75c-21645da26a0a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 Aug 26 03:20:09 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:09 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315a3752-aca0-4e0a-b75c-21645da26a0a -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484" returned: 0 in 0.316s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:09 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 is being set with open permissions: ugo+rw Aug 26 03:20:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:09 devstack sudo[115097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 Aug 26 03:20:09 devstack sudo[115097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:09 devstack sudo[115097]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484" returned: 0 in 0.255s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:09 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:09 devstack sudo[115103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.info Aug 26 03:20:09 devstack sudo[115103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:10 devstack sudo[115103]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.info" returned: 0 in 0.265s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:10 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.info is being set with open permissions: ugo+rw Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:10 devstack sudo[115106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.info Aug 26 03:20:10 devstack sudo[115106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:10 devstack sudo[115106]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.info" returned: 0 in 0.252s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:10 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-64edcb9c-dc30-4330-8dc0-bdd1645200ef tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-48fc4b80-2116-4c3b-b266-c279655a8484-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-48fc4b80-2116-4c3b-b266-c279655a8484-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-315a3752-aca0-4e0a-b75c-21645da26a0a" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-315a3752-aca0-4e0a-b75c-21645da26a0a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-48fc4b80-2116-4c3b-b266-c279655a8484" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-48fc4b80-2116-4c3b-b266-c279655a8484" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot 48fc4b80-2116-4c3b-b266-c279655a8484 of volume 315a3752-aca0-4e0a-b75c-21645da26a0a {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e27408b-2d89-4f23-83cf-f694bca1ed09]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:10 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:10 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 Aug 26 03:20:10 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:11 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484" returned: 0 in 0.365s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:11 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-315a3752-aca0-4e0a-b75c-21645da26a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:20:11 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[15711cf8-6288-4f8e-991b-6cc55121b3af]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:11 devstack sudo[115114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a Aug 26 03:20:11 devstack sudo[115114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:11 devstack sudo[115114]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a" returned: 0 in 0.378s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:11 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 Aug 26 03:20:11 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:11 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484" returned: 0 in 0.379s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:11 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:11 devstack sudo[115124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484 Aug 26 03:20:11 devstack sudo[115124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:12 devstack sudo[115124]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a.48fc4b80-2116-4c3b-b266-c279655a8484" returned: 0 in 0.256s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-48fc4b80-2116-4c3b-b266-c279655a8484" released by "_delete_snapshot" :: held 1.466s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-315a3752-aca0-4e0a-b75c-21645da26a0a" released by "delete_snapshot" :: held 1.493s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Created reservations ['9b9979ae-2440-4ea4-b8d8-43ed54059052', '595b030c-8902-421a-92db-bc69c4959bbf', 'f3831ce0-e453-42af-b3c5-27b273b179b9', 'bbabc6a9-200f-42ff-9a4f-e212ae8919d0'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:12 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-7759f2eb-65be-4a4c-b5cf-367934bacc6e tempest-ProjectMemberTests-1195824779 None] Lock "cinder-48fc4b80-2116-4c3b-b266-c279655a8484-delete_snapshot" released by "delete_snapshot" :: held 1.628s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-315a3752-aca0-4e0a-b75c-21645da26a0a-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-315a3752-aca0-4e0a-b75c-21645da26a0a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-315a3752-aca0-4e0a-b75c-21645da26a0a" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-315a3752-aca0-4e0a-b75c-21645da26a0a" acquired by "delete_volume" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d58568-2d3f-4df3-8ab8-5f58b07d9edb]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:12 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:12 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a Aug 26 03:20:12 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:13 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a" returned: 0 in 0.380s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:13 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a Aug 26 03:20:13 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:13 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-315a3752-aca0-4e0a-b75c-21645da26a0a" returned: 0 in 0.262s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-315a3752-aca0-4e0a-b75c-21645da26a0a" released by "delete_volume" :: held 0.703s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Created reservations ['16e5e250-7c83-4059-b6ca-0611425d84da', '2c481392-3b8f-4010-ae80-9a9eebc0b25f', '82bfc016-5db8-41bd-92e8-23c2b8d71124', 'b62f3163-b369-4f56-acd4-5c1518c1e45d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:13 devstack sudo[115135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:20:13 devstack sudo[115135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:13 devstack sudo[115135]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.287s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:13 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:20:13 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-f8d15796-7188-4269-b078-1326b2cff766 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-315a3752-aca0-4e0a-b75c-21645da26a0a-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (2935f004-35ea-46d0-9a1b-7fa65192d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eca0d0b-c4e4-4c8a-876c-2c9856f13959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eca0d0b-c4e4-4c8a-876c-2c9856f13959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948225241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714aa677-d7e7-4966-a38e-d3249fa7bc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:14Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e2cae6-52e6-4913-b2e7-7de79a9b44dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e2cae6-52e6-4913-b2e7-7de79a9b44dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef1fbdf-1991-4770-8f38-53e9f18724d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef1fbdf-1991-4770-8f38-53e9f18724d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714aa677-d7e7-4966-a38e-d3249fa7bc47', 'volume_name': 'volume-714aa677-d7e7-4966-a38e-d3249fa7bc47', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ffc940-86e6-4aad-a2ae-f5048ecd232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ffc940-86e6-4aad-a2ae-f5048ecd232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f975cc2c-3f02-4a14-b12a-25972214f7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:14 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Volume 714aa677-d7e7-4966-a38e-d3249fa7bc47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714aa677-d7e7-4966-a38e-d3249fa7bc47', 'volume_size': 1} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948225241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714aa677-d7e7-4966-a38e-d3249fa7bc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:14Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Creating volume 714aa677-d7e7-4966-a38e-d3249fa7bc47 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:14 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:14 devstack sudo[115138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 1073741824 Aug 26 03:20:14 devstack sudo[115138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:14 devstack sudo[115138]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 1073741824" returned: 0 in 0.439s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:14 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:14 devstack sudo[115144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 Aug 26 03:20:14 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:15 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47" returned: 0 in 0.265s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f975cc2c-3f02-4a14-b12a-25972214f7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714aa677-d7e7-4966-a38e-d3249fa7bc47', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941c8822-e34f-4eae-9016-fda7a0efbca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:15 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Volume volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 (714aa677-d7e7-4966-a38e-d3249fa7bc47): created successfully Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941c8822-e34f-4eae-9016-fda7a0efbca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (2935f004-35ea-46d0-9a1b-7fa65192d496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:15 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-f359d4ef-d897-46b7-b6b5-06e838ef7f2b tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot 5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 of volume 714aa677-d7e7-4966-a38e-d3249fa7bc47 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a668bd-23f1-4f14-8dd8-cb5c858d2357]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:15 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 Aug 26 03:20:15 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:15 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47" returned: 0 in 0.368s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:15 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:16 devstack sudo[115152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 1G Aug 26 03:20:16 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:16 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 1G" returned: 0 in 0.400s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:16 devstack sudo[115159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 Aug 26 03:20:16 devstack sudo[115159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:16 devstack sudo[115159]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7" returned: 0 in 0.290s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:16 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 is being set with open permissions: ugo+rw Aug 26 03:20:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:16 devstack sudo[115164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 Aug 26 03:20:16 devstack sudo[115164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:16 devstack sudo[115164]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7" returned: 0 in 0.256s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:16 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:16 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.info Aug 26 03:20:16 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:17 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.info" returned: 0 in 0.262s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:17 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.info is being set with open permissions: ugo+rw Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:17 devstack sudo[115171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.info Aug 26 03:20:17 devstack sudo[115171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:17 devstack sudo[115171]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.info" returned: 0 in 0.256s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:17 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-ce5f1cb6-58fb-45e8-9b37-f6366be6b3a0 tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-5045d0cf-0edc-4cc0-b6ff-74e406abcbf7-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-5045d0cf-0edc-4cc0-b6ff-74e406abcbf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-714aa677-d7e7-4966-a38e-d3249fa7bc47" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-714aa677-d7e7-4966-a38e-d3249fa7bc47" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-5045d0cf-0edc-4cc0-b6ff-74e406abcbf7" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-5045d0cf-0edc-4cc0-b6ff-74e406abcbf7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot 5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 of volume 714aa677-d7e7-4966-a38e-d3249fa7bc47 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d47233-51bb-41c2-a392-fc6b1c0120e4]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:17 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:17 devstack sudo[115174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 Aug 26 03:20:17 devstack sudo[115174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:18 devstack sudo[115174]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7" returned: 0 in 0.380s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:18 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-714aa677-d7e7-4966-a38e-d3249fa7bc47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:20:18 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[46431ef2-bd76-412d-a80c-8ae25f3a76ab]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:18 devstack sudo[115179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 Aug 26 03:20:18 devstack sudo[115179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:18 devstack sudo[115179]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47" returned: 0 in 0.402s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:18 devstack sudo[115184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 Aug 26 03:20:18 devstack sudo[115184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:18 devstack sudo[115184]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7" returned: 0 in 0.343s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:18 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:19 devstack sudo[115189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7 Aug 26 03:20:19 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:19 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47.5045d0cf-0edc-4cc0-b6ff-74e406abcbf7" returned: 0 in 0.282s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-5045d0cf-0edc-4cc0-b6ff-74e406abcbf7" released by "_delete_snapshot" :: held 1.506s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-714aa677-d7e7-4966-a38e-d3249fa7bc47" released by "delete_snapshot" :: held 1.533s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Created reservations ['128e9c73-d4bd-494d-a60a-8bd61bc009ed', 'dff302ff-8002-4a78-9d6e-debebe5522a7', 'd2bc5eb1-dfdf-44b3-9ad0-6388644bf58c', '197fa5fb-1115-4240-ae1c-70b89385dc6d'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:19 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-6459ca25-5ccc-408e-9b9e-cab069d67bd7 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-5045d0cf-0edc-4cc0-b6ff-74e406abcbf7-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-714aa677-d7e7-4966-a38e-d3249fa7bc47-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Lock "cinder-714aa677-d7e7-4966-a38e-d3249fa7bc47-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-714aa677-d7e7-4966-a38e-d3249fa7bc47" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:19 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-714aa677-d7e7-4966-a38e-d3249fa7bc47" acquired by "delete_volume" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d70d89-d186-4f35-bc36-5bda251407ab]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:20 devstack sudo[115192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 Aug 26 03:20:20 devstack sudo[115192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:20 devstack sudo[115192]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47" returned: 0 in 0.372s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:20 devstack sudo[115197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47 Aug 26 03:20:20 devstack sudo[115197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:20 devstack sudo[115197]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-714aa677-d7e7-4966-a38e-d3249fa7bc47" returned: 0 in 0.258s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-714aa677-d7e7-4966-a38e-d3249fa7bc47" released by "delete_volume" :: held 0.689s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Created reservations ['f14b180e-5d68-4db8-a91c-e38a0633b22b', '02735d8d-18ac-4ff0-9a8c-5e48263ce3c9', 'f5f52015-ecb8-4dbc-b1bf-f7e9ec4f7b01', 'bce1e5f5-74d4-429b-ab1e-951bacab5f3b'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:20 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:20 devstack sudo[115200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:20:20 devstack sudo[115200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:21 devstack sudo[115200]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.252s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:21 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-afbaf6e8-d620-4b4d-b927-9c2f8d27890b tempest-ProjectMemberTests-1195824779 None] Lock "cinder-714aa677-d7e7-4966-a38e-d3249fa7bc47-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.flows.manager.create_volume [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93797) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (583c8b54-a935-484d-b3c4-72dfeebfb399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dc9fd0-1184-41e3-b5c1-5a77a84df022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dc9fd0-1184-41e3-b5c1-5a77a84df022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121484054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:21Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5494304-ce3f-475d-b5f2-5164f9b97ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5494304-ce3f-475d-b5f2-5164f9b97ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9dc783-98c9-4c01-9be8-c95085766849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9dc783-98c9-4c01-9be8-c95085766849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2', 'volume_name': 'volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b21880-da4b-49b3-8a9c-1bffce9965dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b21880-da4b-49b3-8a9c-1bffce9965dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2991dec-63ad-4530-9bfe-b4826ab9e414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:21 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Volume 6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2', 'volume_size': 1} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121484054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe00a81aa1d4416e87fc7ec7ae602994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:21Z,use_quota=True,user_id='e30d47102b424d0e85429240ea9c6790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9faa593c-48ee-43e6-835f-fef89090c520),volume_type_id=9faa593c-48ee-43e6-835f-fef89090c520)}" {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Creating volume 6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 {{(pid=93797) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b as target Quobyte volume. {{(pid=93797) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:21 devstack cinder-volume[93797]: INFO cinder.volume.drivers.remotefs [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b Aug 26 03:20:21 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 1073741824 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:21 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 1073741824 Aug 26 03:20:21 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:22 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 1073741824" returned: 0 in 0.399s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:22 devstack sudo[115209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 Aug 26 03:20:22 devstack sudo[115209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:22 devstack sudo[115209]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" returned: 0 in 0.265s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'} {{(pid=93797) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2991dec-63ad-4530-9bfe-b4826ab9e414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2', 'volume_size': 1}' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352d6d8e-e8fc-4bf1-bffe-961e71a74be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:22 devstack cinder-volume[93797]: INFO cinder.volume.flows.manager.create_volume [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Volume volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 (6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2): created successfully Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352d6d8e-e8fc-4bf1-bffe-961e71a74be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93797) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Flow 'volume_create_manager' (583c8b54-a935-484d-b3c4-72dfeebfb399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93797) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:22 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-769f6780-1687-47bb-ae27-4cf7fe0e1882 tempest-ProjectMemberTests-1195824779 None] Created volume successfully. Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Creating offline snapshot f4c1a51b-5389-4824-90eb-3d0e659feea8 of volume 6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 {{(pid=93797) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[79032cc0-2e87-49a3-b98d-cb7fdc5a58f9]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:22 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:22 devstack sudo[115212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 Aug 26 03:20:22 devstack sudo[115212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:23 devstack sudo[115212]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" returned: 0 in 0.358s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 1G {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:23 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 1G Aug 26 03:20:23 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:23 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 1G" returned: 0 in 0.421s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:23 devstack sudo[115223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 Aug 26 03:20:23 devstack sudo[115223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:23 devstack sudo[115223]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 -F qcow2 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8" returned: 0 in 0.326s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:23 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 is being set with open permissions: ugo+rw Aug 26 03:20:23 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:23 devstack sudo[115228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 Aug 26 03:20:23 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:24 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8" returned: 0 in 0.257s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:24 devstack sudo[115231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.info Aug 26 03:20:24 devstack sudo[115231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:24 devstack sudo[115231]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.info" returned: 0 in 0.293s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:24 devstack cinder-volume[93797]: WARNING cinder.volume.drivers.remotefs [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.info is being set with open permissions: ugo+rw Aug 26 03:20:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.info {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:24 devstack sudo[115234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.info Aug 26 03:20:24 devstack sudo[115234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:24 devstack sudo[115234]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.info" returned: 0 in 0.262s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:24 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:24 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-22e4e9c4-b2a1-48d7-8ec1-49b5cc6ac03a tempest-ProjectMemberTests-1195824779 None] Create snapshot completed successfully Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-f4c1a51b-5389-4824-90eb-3d0e659feea8-delete_snapshot" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Lock "cinder-f4c1a51b-5389-4824-90eb-3d0e659feea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" by "delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-f4c1a51b-5389-4824-90eb-3d0e659feea8" by "_delete_snapshot" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-f4c1a51b-5389-4824-90eb-3d0e659feea8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Deleting offline snapshot f4c1a51b-5389-4824-90eb-3d0e659feea8 of volume 6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] snapshot_file for this snap is: volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 {{(pid=93797) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[796fabf2-f821-44d8-a4a3-d2ccf550d88a]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:25 devstack sudo[115237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 Aug 26 03:20:25 devstack sudo[115237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:25 devstack sudo[115237]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8" returned: 0 in 0.407s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.remotefs [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93797) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac6e16-533e-422a-a12e-66a7f2d52542]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:25 devstack sudo[115242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 Aug 26 03:20:25 devstack sudo[115242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:25 devstack sudo[115242]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" returned: 0 in 0.379s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:25 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:25 devstack sudo[115247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 Aug 26 03:20:25 devstack sudo[115247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:26 devstack sudo[115247]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8" returned: 0 in 0.366s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:26 devstack sudo[115252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8 Aug 26 03:20:26 devstack sudo[115252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:26 devstack sudo[115252]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:26 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2.f4c1a51b-5389-4824-90eb-3d0e659feea8" returned: 0 in 0.273s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-f4c1a51b-5389-4824-90eb-3d0e659feea8" released by "_delete_snapshot" :: held 1.527s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" released by "delete_snapshot" :: held 1.554s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:26 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Created reservations ['4f754424-f7e1-420c-b128-dba2555b9183', 'f0e81a5a-7c18-4cda-9241-374cc6fdc5e5', '8c44d98e-9c71-4c86-9092-7cb963971954', '1f27db92-f2ea-43fe-9a73-0c7757365eca'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:26 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Delete snapshot completed successfully. Aug 26 03:20:26 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-d9b3949d-25fa-43ce-87cc-97843f3689da tempest-ProjectMemberTests-1195824779 None] Lock "cinder-f4c1a51b-5389-4824-90eb-3d0e659feea8-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2-delete_volume" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "cinder-quobyte-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" by "delete_volume" {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" acquired by "delete_volume" :: waited 0.021s {{(pid=93797) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4c34d2-49e5-41e7-9cfb-874a4e800185]: (4, 'qcow2') {{(pid=95175) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:27 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 Aug 26 03:20:27 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:27 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" returned: 0 in 0.366s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:27 devstack sudo[115261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2 Aug 26 03:20:27 devstack sudo[115261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:27 devstack sudo[115261]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6/volume-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" returned: 0 in 0.257s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-quobyte-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2" released by "delete_volume" :: held 0.680s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:27 devstack cinder-volume[93797]: DEBUG cinder.quota [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Created reservations ['13915e05-152c-4480-ab6d-fb9d16e03bfb', '9e6107d2-0f37-49dd-8379-780378d25c02', '70592287-868f-4716-a6e1-581a920b0ca3', '44272d9a-16ec-4e9d-9371-3686108e1889'] {{(pid=93797) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b': None} {{(pid=93797) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG cinder.volume.drivers.quobyte [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab1c03a2-3c06-42d8-9f9f-b3c4da0d4b1b'] {{(pid=93797) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.lockutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93797) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:28 devstack sudo[115264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6 Aug 26 03:20:28 devstack sudo[115264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:28 devstack sudo[115264]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG oslo_concurrency.processutils [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5e8b96fe9a635050671c3fb438ee63f6" returned: 0 in 0.266s {{(pid=93797) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG cinder.manager [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Notifying Schedulers of capabilities ... {{(pid=93797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:28 devstack cinder-volume[93797]: INFO cinder.volume.manager [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Deleted volume successfully. Aug 26 03:20:28 devstack cinder-volume[93797]: DEBUG cinder.coordination [None req-4786a786-0709-49eb-8c14-2efcb34cd3a6 tempest-ProjectMemberTests-1195824779 None] Lock "cinder-6d3a35c2-d458-4fdd-a98b-9fbc3215bdc2-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=93797) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:38 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:INSERT=41,cinder:UPDATE=154,cinder:SELECT=114,cinder:DELETE=10 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:20:38 devstack cinder-volume[93797]: DEBUG dbcounter [-] [93797] Writing DB stats cinder:SELECT=117,cinder:INSERT=45,cinder:UPDATE=154,cinder:DELETE=14 {{(pid=93797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}